00000001:02000400:3.0F:1789126639.849450:0:3295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789126656.538214:0:3516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789126658.331479:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 727 MB/s 00000001:01000000:2.0F:1789126658.580716:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:2.0:1789126658.830913:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4671 MB/s 00000020:02000000:1.0F:1789126659.406377:0:3608:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_137_gfce00d1 00000400:02000000:3.0:1789126660.080435:0:3623:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.123@tcp [8/256/0/180] 00008000:02000000:2.0:1789126662.978515:0:3773:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789126717.317594:0:5739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789126727.937273:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789126727.937279:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789126727.937281:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789126727.937430:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000053eddb04 00000080:02000400:1.0:1789126727.937447:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789126727.942611:0:6489:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789126727.942624:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789126727.942679:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a79c81cd) 00000020:00000080:1.0:1789126727.942699:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789126728.025546:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789126728.025613:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789126728.064095:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789126728.064299:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789126728.064307:0:6489:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789126728.064317:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea45f 00000020:01000004:3.0:1789126728.064321:0:6489:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789126728.064401:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789126728.064414:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000053eddb04 from MGS 00000020:01000004:3.0:1789126728.064418:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789126728.064434:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000f6bb878) 00000020:00000080:3.0:1789126728.064445:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789126728.064840:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000053eddb04 from MGS, refs=2 00080000:01000000:3.0:1789126728.064846:0:6489:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789126728.064923:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea46d 00000100:00100000:3.0:1789126728.065019:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789126728.065141:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789126728.065147:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789126728.068305:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789126728.068317:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789126728.069427:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126728.069787:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789126728.069793:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789126728.071641:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789126728.071749:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789126728.072520:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789126728.072594:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789126728.074082:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126728.074087:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126728.074089:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126728.074430:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126728.074433:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126728.074434:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126728.075267:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789126728.080945:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789126728.324783:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4427 MB/s 00000001:01000000:2.0:1789126728.574683:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7179 MB/s 00000001:01000000:0.0:1789126728.825317:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1131 MB/s 00000001:01000000:1.0:1789126729.074950:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1431 MB/s 00080000:10000000:1.0:1789126729.078812:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1789126729.091314:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789126729.092707:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789126729.092874:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789126729.092919:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789126729.093625:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789126729.093754:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789126729.094534:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789126729.094715:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789126729.094721:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789126729.096179:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789126729.096188:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789126729.096988:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789126729.096996:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789126729.102956:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789126729.102977:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:3.0:1789126729.102979:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1789126729.103002:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1789126729.103022:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:3.0:1789126729.103031:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (000000002f8df744) 00000020:00000080:3.0:1789126729.103042:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789126729.103128:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008542c7a1@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789126729.103270:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:3.0:1789126729.103277:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789126729.103750:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789126729.103795:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid def09dbb-e047-4ff8-a277-077b6777bba2) 00000020:00000080:1.0:1789126729.103811:0:6489:0:(genops.c:1385:class_connect()) connect: client def09dbb-e047-4ff8-a277-077b6777bba2, cookie 0xa840b4da666ea47b 00000100:00080000:1.0:1789126729.103820:0:6489:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126729.103825:0:6489:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import 000000008542c7a1 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126729.103851:0:6489:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b08bbef1 x1876035276636288/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789126729.103870:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import def09dbb-e047-4ff8-a277-077b6777bba2->MGS 00000020:01000004:1.0:1789126729.103899:0:6489:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789126729.103919:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789126729.103927:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007ead7896) 00000100:00100000:3.0:1789126729.103932:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b08bbef1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276636288:0@lo:250: 00000020:00000080:1.0:1789126729.103937:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789126729.104012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.104078:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636288 00000100:00100000:3.0:1789126729.104085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636288 00000100:00100000:3.0:1789126729.104113:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126729.104120:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b48a044a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1876035276636288:12345-0@lo:250: 00010000:00080000:3.0:1789126729.104153:0:6505:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from def09dbb-e047-4ff8-a277-077b6777bba2@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1789126729.104174:0:6505:0:(genops.c:1385:class_connect()) connect: client def09dbb-e047-4ff8-a277-077b6777bba2, cookie 0xa840b4da666ea489 00000100:00080000:3.0:1789126729.104356:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000689f6b15 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789126729.104420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b48a044a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+5:3638:x1876035276636288:12345-0@lo:250: Request processed in 300us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126729.104428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126729.104466:0:3638:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789126729.104473:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:3.0:1789126729.104478:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789126729.104482:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789126729.104485:0:3638:0:(import.c:65:import_set_state_nolock()) 000000008542c7a1 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789126729.104487:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789126729.104494:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789126729.104497:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b08bbef1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276636288:0@lo:250: 00000100:00100000:3.0:1789126729.124294:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126729.124600:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789126729.124606:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789126729.126230:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789126729.126238:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789126729.128813:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789126729.128832:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789126729.130030:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126729.130202:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789126729.130207:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00010000:00010000:0.0:1789126729.130948:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126729.132161:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789126729.132171:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789126729.173815:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789126729.174029:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789126729.174035:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789126729.175219:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789126729.175227:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789126729.175913:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789126729.176062:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789126729.176067:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789126729.177768:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789126729.177782:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789126729.179630:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126729.180872:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789126729.180882:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789126729.181933:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789126729.181946:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789126729.183028:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126729.183196:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789126729.183201:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789126729.184008:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789126729.184017:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789126729.202962:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789126729.203319:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789126729.203326:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789126729.206218:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789126729.206232:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789126729.211010:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789126729.211025:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789126729.212219:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789126729.212246:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789126729.212253:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789126729.212337:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789126729.212367:0:6489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789126729.212371:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789126729.212373:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.212374:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.212375:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126729.212376:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.212377:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.212379:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.212380:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.212381:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126729.212386:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126729.212388:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.212389:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789126729.212391:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789126729.212404:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789126729.212405:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.212406:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.212407:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126729.212408:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.212409:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.212410:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.212411:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.212411:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126729.212412:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126729.212413:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.212414:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789126729.212443:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789126729.212457:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636416:0@lo:253: 00000100:00100000:3.0:1789126729.212520:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.212566:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2ec7c4f going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.212732:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636416 00000100:00100000:0.0:1789126729.212740:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636416 00000100:00100000:0.0:1789126729.212793:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789126729.212800:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c656dcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+5:6489:x1876035276636416:12345-0@lo:253: 20000000:01000000:0.0:1789126729.212839:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789126729.212842:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789126729.215285:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789126729.215694:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789126729.215977:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126729.217198:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789126729.217620:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789126729.217624:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789126729.217630:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789126729.217633:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789126729.217644:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789126729.218072:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789126729.218214:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789126729.218227:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789126729.218243:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789126729.218436:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789126729.218473:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789126729.218527:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789126729.219073:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789126729.219093:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789126729.219099:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789126729.219176:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789126729.219183:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789126729.219196:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789126729.219212:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789126729.219261:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789126729.219266:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789126729.219275:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789126729.219634:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789126729.219644:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789126729.219807:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789126729.219825:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789126729.219840:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789126729.219857:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789126729.219885:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789126729.219892:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789126729.219902:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789126729.219915:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789126729.219929:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789126729.219937:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789126729.219958:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789126729.219965:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789126729.220056:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789126729.220088:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789126729.220144:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789126729.220163:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789126729.220169:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789126729.220837:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789126729.220941:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789126729.220960:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.123@tcp for mdt 20000000:01000000:1.0:1789126729.220961:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:1.0:1789126729.221045:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789126729.221051:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789126729.221061:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789126729.221064:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:1.0:1789126729.221070:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789126729.221074:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789126729.221080:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789126729.221088:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789126729.221110:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789126729.221113:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789126729.221116:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789126729.221156:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789126729.221159:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789126729.221496:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789126729.221627:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789126729.221685:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789126729.221703:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789126729.221711:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789126729.221713:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789126729.222120:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789126729.222266:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789126729.222286:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789126729.222300:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789126729.222311:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789126729.222313:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789126729.222317:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789126729.222320:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789126729.222329:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789126729.222336:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789126729.222902:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789126729.222999:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789126729.228254:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789126729.228278:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789126729.228286:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789126729.228300:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789126729.228316:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228329:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228345:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228353:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228359:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228366:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228371:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c3ed348 already unused, calling callback (0000000064ef3424) 00010000:00010000:0.0:1789126729.228374:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228381:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228428:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228436:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.228442:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c3ed348/0xa840b4da666ea490 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789126729.228470:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789126729.236233:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c656dcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+5:6489:x1876035276636416:12345-0@lo:253: Request processed in 23428us (23707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.236245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789126729.236479:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636416:0@lo:253: 10000000:01000000:3.0:1789126729.236494:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789126729.236497:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789126729.236498:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.236500:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.236501:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789126729.236502:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.236504:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.236505:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.236506:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.236507:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789126729.236509:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.236510:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789126729.236593:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000053eddb04 from lustre-MDT0000 10000000:01000000:3.0:1789126729.236628:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789126729.236630:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789126729.236635:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9942290f0000 10000000:01000000:3.0:1789126729.236639:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789126729.236699:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f0000 from 1 10000000:01000000:3.0:1789126729.236702:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789126729.236747:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.236759:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.236768:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126729.236786:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636544:0@lo:101: 00000100:00100000:3.0:1789126729.236820:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.236919:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044293fca going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.237019:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636544 00000100:00100000:0.0:1789126729.237025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636544 00000100:00100000:0.0:1789126729.237064:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789126729.237072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1289fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+5:6489:x1876035276636544:12345-0@lo:101: 00010000:00010000:0.0:1789126729.237084:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126729.237097:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea497 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237117:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea497 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237126:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea497 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237134:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c3ed348, rc 0) 00000100:00100000:0.0:1789126729.237177:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1289fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+6:6489:x1876035276636544:12345-0@lo:101: Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.237188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789126729.237213:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636544:0@lo:101: 00010000:00010000:3.0:1789126729.237226:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.237233:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126729.237277:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636672:0@lo:501: 00000100:00100000:3.0:1789126729.237300:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.237320:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044293fca going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.237343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636672 00000100:00100000:0.0:1789126729.237348:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636672 00000100:00100000:0.0:1789126729.237378:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789126729.237384:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077fc6d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+6:6489:x1876035276636672:12345-0@lo:501: 00000100:00100000:0.0:1789126729.237471:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077fc6d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+6:6489:x1876035276636672:12345-0@lo:501: Request processed in 87us (170us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789126729.237477:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789126729.237552:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636672:0@lo:501: 10000000:01000000:1.0:1789126729.237580:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789126729.237591:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.237599:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.237606:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994212236800 10000000:01000000:1.0:1789126729.237610:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789126729.237614:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff994212236800 10000000:01000000:1.0:1789126729.237616:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789126729.237618:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff994212236800 from 1 10000000:01000000:1.0:1789126729.237620:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789126729.237635:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.237641:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.237681:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.237694:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636800:0@lo:101: 00000100:00100000:1.0:1789126729.237720:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.237756:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a636a3b5 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.237836:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636800 00000100:00100000:0.0:1789126729.237845:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636800 00000100:00100000:0.0:1789126729.237877:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126729.237884:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006830690f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+6:6489:x1876035276636800:12345-0@lo:101: 00010000:00010000:0.0:1789126729.237891:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126729.237899:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc8ac814/0xa840b4da666ea4ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea4a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237912:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc8ac814/0xa840b4da666ea4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea4a5 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237919:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc8ac814/0xa840b4da666ea4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea4a5 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.237925:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc8ac814, rc 0) 00000100:00100000:0.0:1789126729.237960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006830690f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+7:6489:x1876035276636800:12345-0@lo:101: Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.237965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789126729.238021:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636800:0@lo:101: 00010000:00010000:1.0:1789126729.238030:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.238036:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.238048:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789126729.238092:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.238099:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000003b7ad6ab/0xa840b4da666ea4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.238105:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789126729.238108:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789126729.238112:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff994212236800 10000000:01000000:1.0:1789126729.238114:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789126729.238117:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789126729.238119:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789126729.238131:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.238137:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.238143:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.238153:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636928:0@lo:101: 00000100:00100000:1.0:1789126729.238181:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.238199:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a636a3b5 going to sleep for 11 seconds 00000100:00100000:2.0:1789126729.238236:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276636928 00000100:00100000:2.0:1789126729.238242:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276636928 00000100:00100000:2.0:1789126729.238289:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789126729.238296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39fc719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+7:6489:x1876035276636928:12345-0@lo:101: 00010000:00010000:2.0:1789126729.238303:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126729.238312:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea4b3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.238407:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.238418:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.238424:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003021e0eb, rc 0) 00000100:00100000:2.0:1789126729.238463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39fc719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+8:6489:x1876035276636928:12345-0@lo:101: Request processed in 168us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126729.238469:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789126729.238493:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276636928:0@lo:101: 00010000:00010000:1.0:1789126729.238505:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.238512:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.238558:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637056:0@lo:501: 00000100:00100000:1.0:1789126729.238582:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.238634:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a636a3b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789126729.238841:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637056 00000100:00100000:3.0:1789126729.238851:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637056 00000100:00100000:3.0:1789126729.238937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789126729.238945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d9da4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+8:6489:x1876035276637056:12345-0@lo:501: 00000100:00100000:3.0:1789126729.239086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d9da4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+9:6489:x1876035276637056:12345-0@lo:501: Request processed in 142us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126729.239094:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789126729.239141:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637056:0@lo:501: 00000100:00100000:1.0:1789126729.239168:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637184:0@lo:503: 00000100:00100000:1.0:1789126729.239205:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.239266:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a636a3b5 going to sleep for 11 seconds 00000100:00100000:2.0:1789126729.239297:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637184 00000100:00100000:2.0:1789126729.239301:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637184 00000100:00100000:2.0:1789126729.239327:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789126729.239333:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000646faa44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+9:6489:x1876035276637184:12345-0@lo:503: 00000100:00100000:2.0:1789126729.239463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000646faa44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+9:6489:x1876035276637184:12345-0@lo:503: Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126729.239470:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789126729.239533:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637184:0@lo:503: 00000100:00100000:3.0:1789126729.240562:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6534:1876035276637312:0@lo:502: 00000100:00100000:3.0:1789126729.240611:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.240926:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d9e8713 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.240969:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637312 00000100:00100000:0.0:1789126729.240975:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637312 00000100:00100000:0.0:1789126729.241056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126729.241064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000787756bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+9:6534:x1876035276637312:12345-0@lo:502: 00000100:00100000:0.0:1789126729.241163:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000787756bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+9:6534:x1876035276637312:12345-0@lo:502: Request processed in 101us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.241170:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789126729.241237:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6534:1876035276637312:0@lo:502: 00000020:01000000:3.0:1789126729.241261:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126729.241271:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126729.241273:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789126729.241277:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789126729.241279:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789126729.241291:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008921c869) 00000020:00000080:3.0:1789126729.241307:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789126729.241312:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789126729.241403:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789126729.241411:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea4c8 00000020:00000080:3.0:1789126729.241617:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789126729.241622:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126729.241625:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126729.241627:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789126729.241629:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126729.241632:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126729.241633:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789126729.241636:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789126729.241642:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ff18a6e8) 00000020:00000080:3.0:1789126729.241795:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789126729.241805:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789126729.241807:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789126729.241809:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789126729.241815:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789126729.241855:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000053eddb04 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789126729.241874:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000038b39e7f) 00000020:00000080:3.0:1789126729.241882:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789126729.241958:0:6534:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789126729.241964:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea4dd 00000020:00000080:3.0:1789126729.242066:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789126729.242072:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789126729.242076:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa840b4da666ea4e4 00080000:01000000:3.0:1789126729.242081:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789126729.242084:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea4eb 00080000:10000000:3.0:1789126729.242516:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789126729.242674:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789126729.248137:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789126729.293726:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789126729.293987:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789126729.296292:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789126729.296751:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789126729.301705:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002757ffad) 00000020:00000080:2.0:1789126729.301733:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789126729.301867:0:6534:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789126729.301874:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea4f9 00000020:00000080:2.0:1789126729.304837:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789126729.306549:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789126729.309072:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.311303:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789126729.313455:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789126729.316719:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789126729.318415:0:6534:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789126729.320056:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa840b4da666ea500 00000020:00000080:0.0:1789126729.321762:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789126729.321777:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126729.321783:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126729.321786:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789126729.321789:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126729.321793:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126729.321794:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789126729.321797:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789126729.321798:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789126729.321800:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126729.321802:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126729.321804:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789126729.321805:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126729.321810:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126729.321811:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789126729.321814:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789126729.321858:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789126729.321917:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6534:1876035276637440:0@lo:502: 00000100:00100000:0.0:1789126729.322011:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126729.322060:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039d991f9 going to sleep for 11 seconds 00000100:00100000:3.0:1789126729.322073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637440 00000100:00100000:3.0:1789126729.322081:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637440 00000100:00100000:3.0:1789126729.322132:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789126729.322141:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003479d571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+9:6534:x1876035276637440:12345-0@lo:502: 00000100:00100000:3.0:1789126729.322262:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003479d571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+9:6534:x1876035276637440:12345-0@lo:502: Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126729.322271:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126729.322574:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6534:1876035276637440:0@lo:502: 00000020:01000000:0.0:1789126729.322602:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126729.322611:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126729.322613:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789126729.322616:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789126729.322808:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789126729.322830:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789126729.322851:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.322862:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.322870:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994212236800 from 1 10000000:01000000:1.0:1789126729.322873:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789126729.322912:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.322919:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.322926:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.322940:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637568:0@lo:101: 00000100:00100000:1.0:1789126729.322974:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.323004:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000107a4e09 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.323028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637568 00000100:00100000:0.0:1789126729.323034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637568 00000100:00100000:0.0:1789126729.323067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789126729.323074:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d8b55e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+9:6489:x1876035276637568:12345-0@lo:101: 00010000:00010000:0.0:1789126729.323084:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126729.323097:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea507 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.323118:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea507 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.323129:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea507 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.323137:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000917e9291, rc 0) 00000100:00100000:0.0:1789126729.323176:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d8b55e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+10:6489:x1876035276637568:12345-0@lo:101: Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.323184:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789126729.323205:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637568:0@lo:101: 00010000:00010000:1.0:1789126729.323219:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.323228:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.323791:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637696:0@lo:256: 00000100:00100000:1.0:1789126729.323828:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.323849:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000107a4e09 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.323874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637696 00000100:00100000:0.0:1789126729.323880:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637696 00000100:00100000:0.0:1789126729.323912:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789126729.323919:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea117f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+10:6489:x1876035276637696:12345-0@lo:256: 20000000:01000000:0.0:1789126729.323933:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789126729.323938:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789126729.324011:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea117f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+10:6489:x1876035276637696:12345-0@lo:256: Request processed in 93us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.324018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789126729.324104:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637696:0@lo:256: 10000000:01000000:1.0:1789126729.324620:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789126729.324639:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.324687:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.324702:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 1 10000000:01000000:1.0:1789126729.324705:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126729.324725:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.324731:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.324738:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.324751:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637824:0@lo:101: 00000100:00100000:1.0:1789126729.325937:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.325978:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000107a4e09 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.326411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637824 00000100:00100000:0.0:1789126729.326418:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637824 00000100:00100000:0.0:1789126729.326454:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789126729.326462:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a76a1ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+10:6489:x1876035276637824:12345-0@lo:101: 00010000:00010000:0.0:1789126729.326475:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126729.326490:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea515 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.326511:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea515 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.326679:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea515 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.326690:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b5faad6, rc 0) 00000100:00100000:0.0:1789126729.326732:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a76a1ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276637824:12345-0@lo:101: Request processed in 271us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.326739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789126729.326824:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637824:0@lo:101: 00010000:00010000:1.0:1789126729.326839:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.326848:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.326908:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637952:0@lo:501: 00000100:00100000:1.0:1789126729.326934:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.326995:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000107a4e09 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.327029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276637952 00000100:00100000:0.0:1789126729.327033:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276637952 00000100:00100000:0.0:1789126729.327097:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789126729.327104:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a88dff3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276637952:12345-0@lo:501: 00000100:00100000:0.0:1789126729.327325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a88dff3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276637952:12345-0@lo:501: Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.327332:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789126729.327408:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276637952:0@lo:501: 00000100:00100000:3.0:1789126729.327450:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638080:0@lo:503: 00000100:00100000:3.0:1789126729.327492:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.327943:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638080 00000100:00100000:1.0:1789126729.327949:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638080 00000100:00100000:3.0:1789126729.327950:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000018d14a9 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.327995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789126729.328005:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d8fc11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276638080:12345-0@lo:503: 00000040:00080000:0.0:1789126729.328038:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789126729.328137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d8fc11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276638080:12345-0@lo:503: Request processed in 135us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.328144:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789126729.328414:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638080:0@lo:503: 00000040:00080000:1.0:1789126729.329598:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789126729.329909:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789126729.329930:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126729.329980:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.330000:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126729.330052:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789126729.330056:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994212236800 10000000:01000000:3.0:1789126729.330059:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994212236800 10000000:01000000:3.0:1789126729.330063:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789126729.330070:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994212236800 from 1 10000000:01000000:3.0:1789126729.330072:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789126729.330102:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.330110:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.330119:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126729.330136:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638208:0@lo:101: 00000100:00100000:3.0:1789126729.330184:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.330269:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000638bb80a going to sleep for 11 seconds 00000100:00100000:1.0:1789126729.330582:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638208 00000100:00100000:1.0:1789126729.330595:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638208 00000100:00100000:1.0:1789126729.330764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789126729.330774:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090d91f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+11:6489:x1876035276638208:12345-0@lo:101: 00010000:00010000:1.0:1789126729.330785:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126729.330798:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea523 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.330819:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.330829:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.330838:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfc898f2, rc 0) 00000100:00100000:1.0:1789126729.330919:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090d91f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638208:12345-0@lo:101: Request processed in 147us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126729.330926:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789126729.330995:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638208:0@lo:101: 00010000:00010000:3.0:1789126729.331008:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.331016:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126729.331066:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638336:0@lo:501: 00000100:00100000:3.0:1789126729.331090:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.331114:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000638bb80a going to sleep for 11 seconds 00000100:00100000:2.0:1789126729.331128:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638336 00000100:00100000:2.0:1789126729.331134:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638336 00000100:00100000:2.0:1789126729.331211:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789126729.331220:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd160886 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638336:12345-0@lo:501: 00000100:00100000:2.0:1789126729.331339:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd160886 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638336:12345-0@lo:501: Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126729.331349:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789126729.331362:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638336:0@lo:501: 00000100:00100000:3.0:1789126729.331403:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638464:0@lo:503: 00000100:00100000:3.0:1789126729.331440:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.331613:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000638bb80a going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.331698:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638464 00000100:00100000:0.0:1789126729.331704:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638464 00000100:00100000:0.0:1789126729.331731:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789126729.331738:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5bb7ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638464:12345-0@lo:503: 00000100:00100000:0.0:1789126729.331839:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5bb7ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638464:12345-0@lo:503: Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.331846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789126729.331923:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638464:0@lo:503: 00000100:00100000:2.0:1789126729.332402:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6539:1876035276638592:0@lo:502: 00000100:00100000:2.0:1789126729.332441:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126729.332498:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ce2be35 going to sleep for 11 seconds 00000100:00100000:0.0:1789126729.332537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638592 00000100:00100000:0.0:1789126729.332542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638592 00000100:00100000:0.0:1789126729.332713:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789126729.332722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a97a197e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6539:x1876035276638592:12345-0@lo:502: 00000100:00100000:0.0:1789126729.332816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a97a197e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6539:x1876035276638592:12345-0@lo:502: Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.332823:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789126729.332887:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6539:1876035276638592:0@lo:502: 00000020:01000004:3.0:1789126729.332938:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789126729.332950:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000066cab55b) 00000020:00000080:3.0:1789126729.332967:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789126729.333059:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000053eddb04 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789126729.333063:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000053eddb04 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789126729.333065:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000053eddb04 4 00010000:00080000:3.0:1789126729.333090:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000039451973@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789126729.334775:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789126729.334994:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789126729.335034:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789126729.335049:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa840b4da666ea538 00000100:00080000:3.0:1789126729.335058:0:6539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789126729.335063:0:6539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000039451973 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789126729.335095:0:6539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc37153c x1876035276638720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789126729.335131:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276638720:0@lo:38: 00000100:00100000:3.0:1789126729.335191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789126729.335246:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789126729.338165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638720 00000100:00100000:0.0:1789126729.338179:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638720 00000100:00100000:0.0:1789126729.338215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789126729.338222:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c725167 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276638720:12345-0@lo:38: 00000100:00100000:0.0:1789126729.338309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c725167 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276638720:12345-0@lo:38: Request processed in 86us (3119us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789126729.338316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789126729.338891:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ef016a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6539:1876035276638848:0@lo:502: 00000100:00100000:2.0:1789126729.338947:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126729.338978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638848 00000100:00100000:2.0:1789126729.338990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638848 00000100:00100000:2.0:1789126729.339024:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126729.339031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc750947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+12:6539:x1876035276638848:12345-0@lo:502: 00000100:00100000:2.0:1789126729.339136:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc750947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+12:6539:x1876035276638848:12345-0@lo:502: Request processed in 106us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126729.339145:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126729.339201:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c33b006 going to sleep for 11 seconds 00000100:00100000:2.0:1789126729.339224:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ef016a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:6539:1876035276638848:0@lo:502: 00000040:00080000:2.0:1789126729.339251:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1789126729.340036:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789126729.340045:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000039451973 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789126729.340051:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789126729.340056:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276638720:0@lo:38: 00000020:01000000:3.0:1789126729.340087:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789126729.340113:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126729.340132:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126729.340142:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789126729.340187:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789126729.340190:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.340191:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.340192:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126729.340193:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.340194:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.340195:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.340197:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.340198:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126729.340199:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126729.340205:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.340206:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789126729.340209:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789126729.340212:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789126729.340213:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.340214:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.340215:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126729.340216:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.340217:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.340218:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.340219:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.340220:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126729.340221:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126729.340222:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.340223:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789126729.340239:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789126729.340252:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638976:0@lo:253: 00000100:00100000:3.0:1789126729.340295:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126729.340330:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c3848db going to sleep for 11 seconds 00000100:00100000:1.0:1789126729.340343:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276638976 00000100:00100000:1.0:1789126729.340350:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276638976 00000100:00100000:1.0:1789126729.340388:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789126729.340406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98b7b5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638976:12345-0@lo:253: 20000000:01000000:1.0:1789126729.340428:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789126729.340440:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789126729.345616:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789126729.345708:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789126729.345960:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789126729.345966:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789126729.345983:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.346000:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.346007:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.346107:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.346122:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126729.346275:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ef016a6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276639104:0@lo:104: 00000100:00100000:1.0:1789126729.346295:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98b7b5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6489:x1876035276638976:12345-0@lo:253: Request processed in 5898us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126729.346306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789126729.346322:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126729.346420:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c33b006 going to sleep for 11 seconds 00000100:00100000:3.0:1789126729.346569:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc37153c pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:6489:1876035276638976:0@lo:253: 10000000:01000000:3.0:1789126729.346590:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789126729.346594:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789126729.346596:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789126729.346597:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126729.346598:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126729.346599:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126729.346601:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126729.346603:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126729.346604:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789126729.346606:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126729.346607:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126729.346609:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126729.346610:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789126729.346623:0:6489:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789126729.347203:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639104 00000100:00100000:0.0:1789126729.347211:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639104 00000100:00100000:0.0:1789126729.347483:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789126729.347492:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab336783 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276639104:12345-0@lo:104: 00010000:00010000:0.0:1789126729.347518:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126729.347664:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ef016a6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276639104:0@lo:104: 00010000:00010000:2.0:1789126729.347685:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126729.347977:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126729.347984:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab336783 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276639104:12345-0@lo:104: Request processed in 494us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126729.347992:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789126729.347999:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126729.348006:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348123:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020301ca6 already unused, calling callback (000000002af92885) 10000000:00010000:1.0:1789126729.348128:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348137:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126729.348142:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126729.348147:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126729.348182:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348189:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126729.348277:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126729.348279:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009228b64a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276639232:0@lo:103: 00010000:00010000:1.0:1789126729.348285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea50e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348301:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126729.348303:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126729.348304:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126729.348318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126729.348522:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639232 00000100:00100000:1.0:1789126729.348528:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639232 00010000:00010000:1.0:1789126729.348547:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126729.348575:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789126729.348596:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef016a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+12:3640:x1876035276639232:12345-0@lo:103: 00010000:00010000:1.0:1789126729.348606:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126729.348609:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348615:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348624:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000917e9291/0xa840b4da666ea50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea507 expref: 12 pid: 6505 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348633:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348639:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789126729.348674:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002708759s 00010000:00010000:1.0:1789126729.348678:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348685:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348690:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348696:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348701:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011252344 already unused, calling callback (0000000064ef3424) 00010000:00010000:1.0:1789126729.348710:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348717:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348737:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126729.348747:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126729.348791:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef016a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+11:3640:x1876035276639232:12345-0@lo:103: Request processed in 199us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126729.348798:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789126729.348818:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009228b64a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276639232:0@lo:103: 00010000:00010000:2.0:1789126729.348833:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.348946:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126729.348954:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011252344/0xa840b4da666ea53f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789126729.352276:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.352446:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789126729.352707:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.352864:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789126729.353046:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.353195:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789126729.354434:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.354569:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789126729.354768:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.354881:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789126729.355015:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789126729.355125:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789126729.360802:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789126729.373625:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789126729.373638:0:6544:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789126729.373643:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789126729.375864:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789126729.377185:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789126729.377280:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789126729.377776:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789126729.377783:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789126729.379800:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789126729.380996:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789126729.381638:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789126729.381751:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789126729.384311:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789126729.384418:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789126729.384795:0:6489:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789126729.387173:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789126729.388715:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789126729.388879:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789126729.389005:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789126729.389125:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789126729.389235:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789126729.389443:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789126729.389625:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789126729.389795:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789126729.389951:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789126729.390080:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789126729.390212:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789126729.390430:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789126729.390615:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789126729.390780:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789126729.390893:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789126729.391127:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789126729.391272:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789126729.391544:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789126729.391686:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789126729.391805:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789126729.391925:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789126729.392035:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789126729.392154:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789126729.392279:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789126729.392547:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789126729.393026:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789126729.393140:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789126729.393293:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789126729.394066:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789126729.394193:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789126729.394303:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789126729.394629:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789126729.394908:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789126729.395026:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789126729.395030:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789126729.398200:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789126729.398246:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb30541c1b988 00100000:10000000:3.0:1789126729.398254:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789126729.399040:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789126729.399055:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789126729.399074:0:6489:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789126729.399088:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789126729.401040:0:6489:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126729.401185:0:6489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789126730.155054:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126731.178871:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126732.218560:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789126732.667220:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789126733.227326:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789126733.619613:0:6842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789126733.619941:0:6842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126734.253458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789126734.506841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789126734.506852:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789126734.506855:0:8:0:(import.c:65:import_set_state_nolock()) 0000000039451973 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789126734.506866:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000039451973 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126734.506896:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a9267d8 x1876035276639488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789126734.507035:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a9267d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276639488:0@lo:38: 00000100:00100000:3.0:1789126734.507124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126734.507236:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639488 00000100:00100000:1.0:1789126734.507242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639488 00000100:00100000:1.0:1789126734.507277:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789126734.507294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000576e609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276639488:12345-0@lo:38: 00010000:00080000:1.0:1789126734.507316:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1789126734.507350:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa840b4da666ea546 00000004:00100000:1.0:1789126734.507400:0:6514:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789126734.507518:0:6514:0:(import.c:65:import_set_state_nolock()) 0000000024a8f3b6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126734.507566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000576e609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876035276639488:12345-0@lo:38: Request processed in 272us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126734.507574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789126734.507992:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002a9267d8 x1876035276639488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789126734.508006:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789126734.508012:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789126734.508016:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789126734.508018:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000039451973 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789126734.508023:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a9267d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276639488:0@lo:38: 00000100:00100000:0.0:1789126734.509165:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126734.509180:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013fb6a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276639360:0@lo:400: 00000100:00100000:0.0:1789126734.509234:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126734.509593:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639360 00000100:00100000:3.0:1789126734.509600:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639360 00000100:00100000:3.0:1789126734.509645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789126734.509679:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c14a7655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+11:3642:x1876035276639360:12345-0@lo:400: 00000100:00100000:3.0:1789126734.509735:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c14a7655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+11:3642:x1876035276639360:12345-0@lo:400: Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126734.509742:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789126734.509919:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013fb6a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276639360:0@lo:400: 00010000:00010000:1.0:1789126735.277621:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789126736.159391:0:6943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126736.159959:0:6943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126736.301803:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789126736.554861:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789126736.554869:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994212236800 from 3 10000000:01000000:0.0:1789126736.554873:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789126736.554923:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126736.554935:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126736.554946:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126736.554985:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276639616:0@lo:101: 00000100:00100000:0.0:1789126736.555056:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126736.555238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639616 00000100:00100000:1.0:1789126736.555246:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639616 00000100:00100000:1.0:1789126736.555302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789126736.555310:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001882ca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+11:6509:x1876035276639616:12345-0@lo:101: 00010000:00010000:1.0:1789126736.555323:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126736.555335:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea54d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126736.555366:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea54d expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126736.555375:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea54d expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126736.555384:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071ff3209, rc 0) 00000100:00100000:1.0:1789126736.555415:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001882ca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:6509:x1876035276639616:12345-0@lo:101: Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126736.555422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789126736.555505:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a93313c1 going to sleep for 11 seconds 00000100:00100000:0.0:1789126736.555525:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276639616:0@lo:101: 00010000:00010000:0.0:1789126736.555537:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126736.555546:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126736.555589:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276639744:0@lo:256: 00000100:00100000:0.0:1789126736.555617:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126736.555640:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a93313c1 going to sleep for 11 seconds 00000100:00100000:3.0:1789126736.555735:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639744 00000100:00100000:3.0:1789126736.555740:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639744 00000100:00100000:3.0:1789126736.555845:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789126736.555853:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e32d7b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:6509:x1876035276639744:12345-0@lo:256: 20000000:01000000:3.0:1789126736.555866:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789126736.555881:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789126736.555884:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789126736.555961:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e32d7b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:6509:x1876035276639744:12345-0@lo:256: Request processed in 110us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126736.555968:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789126736.556008:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc405fac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276639744:0@lo:256: 10000000:01000000:3.0:1789126736.556051:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789126736.556057:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126736.556063:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126737.326556:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126738.347781:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126739.371471:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126739.626886:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276640000:0@lo:400: 00000100:00100000:2.0:1789126739.626955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126739.627027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640000 00000100:00100000:2.0:1789126739.627034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640000 00000100:00100000:2.0:1789126739.627071:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789126739.627080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f83f3ba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276640000:12345-0@lo:400: 00000100:00100000:2.0:1789126739.627131:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f83f3ba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276640000:12345-0@lo:400: Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126739.627137:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789126739.627180:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f08783b x1876035276640000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126739.627194:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276640000:0@lo:400: 00000100:00100000:3.0:1789126739.627355:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126739.627364:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000994562d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276639872:0@lo:400: 00000100:00100000:3.0:1789126739.627396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126739.627426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276639872 00000100:00100000:3.0:1789126739.627430:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276639872 00000100:00100000:3.0:1789126739.627457:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789126739.627464:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d08360a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:3641:x1876035276639872:12345-0@lo:400: 00000100:00100000:3.0:1789126739.627496:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d08360a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:3641:x1876035276639872:12345-0@lo:400: Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126739.627508:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789126739.627544:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000994562d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276639872:0@lo:400: 00010000:00010000:2.0:1789126740.397183:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126741.418813:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126742.449929:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126743.469015:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126744.492780:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126744.747796:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126744.747828:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df7c24c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276640128:0@lo:400: 00000100:00100000:0.0:1789126744.747892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126744.747942:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276640256:0@lo:400: 00000100:00100000:0.0:1789126744.747971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126744.748005:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640128 00000100:00100000:0.0:1789126744.748012:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640128 00000100:00100000:0.0:1789126744.748050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126744.748057:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abbdaf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+12:3639:x1876035276640128:12345-0@lo:400: 00000100:00100000:0.0:1789126744.748100:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abbdaf43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+12:3639:x1876035276640128:12345-0@lo:400: Request processed in 44us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126744.748116:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126744.748145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640256 00000100:00100000:0.0:1789126744.748149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640256 00000100:00100000:0.0:1789126744.748174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789126744.748180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000609c2b8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276640256:12345-0@lo:400: 00000100:00100000:0.0:1789126744.748213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000609c2b8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276640256:12345-0@lo:400: Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126744.748219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789126744.748254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf36ea4d x1876035276640256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126744.748266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276640256:0@lo:400: 00000100:00100000:0.0:1789126744.748302:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df7c24c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276640128:0@lo:400: 00010000:00010000:0.0:1789126745.523941:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126746.543215:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789126747.520431:0:7441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789126747.520437:0:7441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789126747.520439:0:7441:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789126747.520607:0:7441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000039e78495 00000020:01000004:2.0:1789126747.520630:0:7441:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789126747.520643:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789126747.520685:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000138ec5b0) 00000020:00000080:2.0:1789126747.520703:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1789126747.572500:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789126747.628520:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789126747.628623:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789126747.674379:0:7441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789126747.692352:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789126747.692372:0:7441:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789126747.692385:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea562 00000020:01000004:0.0:1789126747.692405:0:7441:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789126747.692431:0:7441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789126747.692435:0:7441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789126747.692442:0:7441:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789126747.692479:0:7441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789126747.692482:0:7441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789126747.732070:0:7441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789126747.732305:0:7441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789126747.732310:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789126747.732311:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789126747.732313:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126747.732314:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126747.732315:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126747.732317:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126747.732318:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126747.732320:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126747.732321:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126747.732323:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126747.732325:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789126747.732328:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789126747.732331:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789126747.732332:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789126747.732333:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126747.732334:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126747.732335:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126747.732336:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126747.732337:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789126747.732338:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126747.732339:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126747.732340:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126747.732341:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789126747.732376:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789126747.732465:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f36794b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276640384:0@lo:253: 00000100:00100000:3.0:1789126747.732563:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126747.732712:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640384 00000100:00100000:0.0:1789126747.732725:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640384 00000100:00100000:0.0:1789126747.732782:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126747.732790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b73ab7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276640384:12345-0@lo:253: 20000000:01000000:0.0:1789126747.732835:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789126747.732839:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789126747.732844:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789126747.732847:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789126747.732883:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789126747.733123:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126747.733244:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789126747.733256:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789126747.733284:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789126747.733301:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789126747.733313:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789126747.733364:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789126747.733371:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789126747.733382:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789126747.733386:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789126747.733401:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789126747.733405:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789126747.733418:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789126747.733431:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789126747.733529:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789126747.733536:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789126747.733547:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789126747.733551:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789126747.733562:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789126747.733566:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1789126747.733576:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789126747.733580:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789126747.733591:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789126747.733603:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789126747.733611:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789126747.733714:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789126747.733722:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789126747.733744:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789126747.733758:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789126747.733772:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789126747.733777:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789126747.733788:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789126747.733803:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789126747.733808:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789126747.733826:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789126747.733832:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000100:00100000:3.0:1789126747.734174:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bf1a2f4 going to sleep for 11 seconds 00000040:00080000:0.0:1789126747.737421:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789126747.738812:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789126747.738852:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.123@tcp for mdt 20000000:01000000:3.0:1789126747.738854:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789126747.738873:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789126747.738881:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789126747.738895:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789126747.738901:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1789126747.738918:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789126747.738926:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789126747.738940:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789126747.738954:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789126747.739015:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789126747.739024:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789126747.742032:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789126747.742324:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789126747.742353:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.123@tcp for mdt 20000000:01000000:0.0:1789126747.742355:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789126747.742369:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789126747.742374:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789126747.742385:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789126747.742389:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1789126747.742400:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789126747.742406:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789126747.742416:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789126747.742429:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789126747.742450:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789126747.742453:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789126747.742456:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789126747.742500:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789126747.742502:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789126747.743796:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789126747.743846:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789126747.743862:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789126747.744067:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789126747.744111:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789126747.744126:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789126747.744136:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789126747.744139:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126747.744731:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126747.744751:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126747.744762:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789126747.744936:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789126747.744968:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789126747.745025:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789126747.745037:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789126747.745040:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789126747.745528:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789126747.745555:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789126747.745569:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789126747.745717:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789126747.745738:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789126747.745752:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789126747.745763:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789126747.745765:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789126747.745770:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789126747.745776:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789126747.748902:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789126747.749293:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789126747.772783:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789126747.775177:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775203:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea497 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775211:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775217:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775223:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775284:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775303:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.775340:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640512:0@lo:104: 00000100:00100000:0.0:1789126747.775429:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789126747.775496:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775504:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 12 pid: 6507 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.775511:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e2c605 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640640:0@lo:104: 00000100:00100000:0.0:1789126747.775533:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789126747.775551:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.775558:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 12 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.775565:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640768:0@lo:104: 00000100:00100000:0.0:1789126747.775585:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126747.775597:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f21335b going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.778578:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640512 00000100:00100000:2.0:1789126747.778597:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640512 00000100:00100000:2.0:1789126747.778691:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640640 00000100:00100000:2.0:1789126747.778695:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640640 00000100:00100000:2.0:1789126747.778710:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640768 00000100:00100000:2.0:1789126747.778713:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640768 00000100:00100000:2.0:1789126747.778763:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126747.778773:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1979cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:6505:x1876035276640512:12345-0@lo:104: 00010000:00010000:2.0:1789126747.778793:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.778909:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126747.778915:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1979cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:6505:x1876035276640512:12345-0@lo:104: Request processed in 144us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.778922:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126747.778942:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126747.778948:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca396432 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276640640:12345-0@lo:104: 00010000:00010000:2.0:1789126747.778954:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779003:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126747.779007:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca396432 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276640640:12345-0@lo:104: Request processed in 61us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.779013:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126747.779026:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126747.779032:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068af6d0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276640768:12345-0@lo:104: 00010000:00010000:2.0:1789126747.779038:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779061:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789126747.779065:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068af6d0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276640768:12345-0@lo:104: Request processed in 35us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.779070:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789126747.779085:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789126747.779105:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779112:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee2eff90 already unused, calling callback (000000002af92885) 10000000:00010000:2.0:1789126747.779116:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779124:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126747.779131:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.779136:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126747.779186:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779193:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126747.779214:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779220:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea52a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779236:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789126747.779239:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779243:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006263be09 already unused, calling callback (000000002af92885) 10000000:00010000:2.0:1789126747.779245:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779250:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126747.779256:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.779260:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126747.779283:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779289:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126747.779303:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779319:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 000000006263be09/0xa840b4da666ea4b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea4ba expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779329:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126747.779331:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779336:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000096de303c already unused, calling callback (000000002af92885) 10000000:00010000:2.0:1789126747.779338:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779344:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126747.779349:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.779355:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126747.779368:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779374:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126747.779378:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000096de303c/0xa840b4da666ea497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea49e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126747.779406:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126747.779407:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126747.779414:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126747.779438:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276640896:0@lo:103: 00000100:00100000:2.0:1789126747.779480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.779535:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276641024:0@lo:103: 00000100:00100000:2.0:1789126747.779557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.779575:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126747.779579:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e8ca3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276641152:0@lo:103: 00000100:00100000:2.0:1789126747.779596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.779628:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276640896 00000100:00100000:2.0:1789126747.779633:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276640896 00010000:00010000:2.0:1789126747.779675:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 13 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.779693:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641024 00000100:00100000:2.0:1789126747.779695:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641024 00010000:00010000:2.0:1789126747.779706:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 14 pid: 6507 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.779716:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641152 00000100:00100000:2.0:1789126747.779718:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641152 00010000:00010000:2.0:1789126747.779728:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 15 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.779739:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126747.779745:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050bfbab0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+15:3642:x1876035276640896:12345-0@lo:103: 00010000:00010000:2.0:1789126747.779756:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126747.779761:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 15 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779778:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 15 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779798:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126747.779827:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050bfbab0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+15:3642:x1876035276640896:12345-0@lo:103: Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.779834:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126747.779847:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126747.779853:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000375e0626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+14:3639:x1876035276641024:12345-0@lo:103: 00010000:00010000:2.0:1789126747.779861:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126747.779865:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 14 pid: 6507 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779873:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 14 pid: 6507 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779882:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126747.779905:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000375e0626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+14:3639:x1876035276641024:12345-0@lo:103: Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.779911:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126747.779921:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126747.779927:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e96a2d3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+13:3639:x1876035276641152:12345-0@lo:103: 00010000:00010000:2.0:1789126747.779934:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126747.779938:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 13 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779946:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 13 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779964:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779973:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779988:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.779995:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780001:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780007:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780013:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b910a79 already unused, calling callback (0000000064ef3424) 00010000:00010000:2.0:1789126747.780016:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780024:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780032:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.780043:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126747.780065:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e96a2d3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+13:3639:x1876035276641152:12345-0@lo:103: Request processed in 138us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.780080:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126747.780123:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e8ca3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276641152:0@lo:103: 00000100:00100000:2.0:1789126747.780132:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276641024:0@lo:103: 00000100:00100000:2.0:1789126747.780157:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276640896:0@lo:103: 00010000:00010000:0.0:1789126747.780353:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfc898f2/0xa840b4da666ea52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea523 expref: 12 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.780366:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640512:0@lo:104: 00010000:00010000:0.0:1789126747.780375:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003021e0eb/0xa840b4da666ea4ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea4b3 expref: 11 pid: 6507 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.780382:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e2c605 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640640:0@lo:104: 00010000:00010000:0.0:1789126747.780389:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c3ed348/0xa840b4da666ea49e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea497 expref: 10 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126747.780405:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276640768:0@lo:104: 00010000:00010000:0.0:1789126747.780424:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.780432:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.780437:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.780442:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b910a79/0xa840b4da666ea569 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789126747.780459:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789126747.783350:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b73ab7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+9:7441:x1876035276640384:12345-0@lo:253: Request processed in 50548us (50776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126747.783369:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789126747.783538:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f36794b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276640384:0@lo:253: 10000000:01000000:1.0:1789126747.783556:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789126747.783560:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789126747.783562:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789126747.783564:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789126747.783565:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789126747.783567:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789126747.783568:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789126747.783569:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789126747.783571:0:7441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789126747.783573:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789126747.783574:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789126747.783604:0:7441:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000039e78495 from lustre-MDT0001 10000000:01000000:1.0:1789126747.783643:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789126747.783678:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789126747.783687:0:7441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f0000 local copy 10000000:01000000:1.0:1789126747.783691:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789126747.783739:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126747.783751:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126747.783761:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126747.783796:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641280:0@lo:101: 00000100:00100000:1.0:1789126747.783844:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126747.783885:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bf1a2f4 going to sleep for 11 seconds 00000100:00100000:0.0:1789126747.785238:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641280 00000100:00100000:0.0:1789126747.785253:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641280 00000100:00100000:0.0:1789126747.785331:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126747.785342:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022f28fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+9:7441:x1876035276641280:12345-0@lo:101: 00010000:00010000:0.0:1789126747.785361:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126747.785381:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff8a23d9/0xa840b4da666ea577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea570 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.785424:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff8a23d9/0xa840b4da666ea577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea570 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.785434:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff8a23d9/0xa840b4da666ea577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea570 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.785459:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff8a23d9, rc 0) 00000100:00100000:0.0:1789126747.785541:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022f28fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+10:7441:x1876035276641280:12345-0@lo:101: Request processed in 201us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126747.785548:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789126747.785913:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641280:0@lo:101: 00010000:00010000:2.0:1789126747.785944:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.785955:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.786108:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641408:0@lo:501: 00000100:00100000:2.0:1789126747.786150:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.786192:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b82b2d0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126747.786280:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641408 00000100:00100000:0.0:1789126747.786285:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641408 00000100:00100000:0.0:1789126747.786320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126747.786327:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009181ed99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+10:7441:x1876035276641408:12345-0@lo:501: 00000100:00100000:0.0:1789126747.786402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009181ed99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+10:7441:x1876035276641408:12345-0@lo:501: Request processed in 75us (252us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789126747.786409:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789126747.786936:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641408:0@lo:501: 10000000:01000000:2.0:1789126747.786952:0:7441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789126747.786973:0:7441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789126747.786979:0:7441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.786988:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.786994:0:7441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.787040:0:7441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789126747.787070:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99423d256000 10000000:01000000:2.0:1789126747.787076:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789126747.787081:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9942290f0000 10000000:01000000:2.0:1789126747.787083:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789126747.787086:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9942290f0000 from 1 10000000:01000000:2.0:1789126747.787099:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789126747.787125:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.787132:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.787140:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.787153:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641536:0@lo:101: 00000100:00100000:2.0:1789126747.787185:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.787250:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3fa85 going to sleep for 11 seconds 00010000:00010000:0.0:1789126747.787613:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126747.787620:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787627:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020301ca6 already unused, calling callback (000000002af92885) 10000000:00010000:0.0:1789126747.787630:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787637:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126747.787644:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126747.787675:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126747.787696:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787712:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126747.787736:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787743:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000020301ca6/0xa840b4da666ea570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea577 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787760:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126747.787762:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126747.787763:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126747.787772:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126747.787785:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276641664:0@lo:103: 00000100:00100000:0.0:1789126747.787818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126747.787856:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641664 00000100:00100000:0.0:1789126747.787861:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641664 00000100:00100000:0.0:1789126747.787899:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789126747.787906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e2c605 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+10:3642:x1876035276641664:12345-0@lo:103: 00010000:00010000:0.0:1789126747.787918:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126747.787941:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff8a23d9/0xa840b4da666ea577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea570 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126747.787958:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126747.787990:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e2c605 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+9:3642:x1876035276641664:12345-0@lo:103: Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126747.787997:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789126747.788028:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276641664:0@lo:103: 00000100:00100000:1.0:1789126747.792041:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641536 00000100:00100000:1.0:1789126747.792063:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641536 00000100:00100000:1.0:1789126747.792172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789126747.792183:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f829bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+9:7441:x1876035276641536:12345-0@lo:101: 00010000:00010000:1.0:1789126747.792207:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126747.792233:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd2b6f78/0xa840b4da666ea585 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea57e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126747.792277:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd2b6f78/0xa840b4da666ea585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea57e expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126747.792291:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd2b6f78/0xa840b4da666ea585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea57e expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126747.792301:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd2b6f78, rc 0) 00000100:00100000:1.0:1789126747.792405:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f829bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+10:7441:x1876035276641536:12345-0@lo:101: Request processed in 224us (5219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126747.792413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789126747.792790:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641536:0@lo:101: 00010000:00010000:2.0:1789126747.792812:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.792822:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.792846:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789126747.792863:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.792879:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000004a6ec8cb/0xa840b4da666ea57e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.792893:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99423d256000 10000000:01000000:2.0:1789126747.792898:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789126747.792903:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99423d256000 from 1 10000000:01000000:2.0:1789126747.792906:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789126747.792945:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.792953:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.792961:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.792981:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641792:0@lo:101: 00000100:00100000:2.0:1789126747.793022:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.793053:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3fa85 going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.793074:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641792 00000100:00100000:2.0:1789126747.793080:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641792 00000100:00100000:2.0:1789126747.793105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789126747.793111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d3a1be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+10:7441:x1876035276641792:12345-0@lo:101: 00010000:00010000:2.0:1789126747.793119:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126747.793128:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a00a2a2b/0xa840b4da666ea593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea58c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793144:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a00a2a2b/0xa840b4da666ea593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea58c expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793158:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a00a2a2b/0xa840b4da666ea593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea58c expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793164:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a00a2a2b, rc 0) 00000100:00100000:2.0:1789126747.793195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d3a1be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+11:7441:x1876035276641792:12345-0@lo:101: Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.793201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789126747.793225:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641792:0@lo:101: 00010000:00010000:2.0:1789126747.793234:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793240:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.793249:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789126747.793251:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793256:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000ab282eff/0xa840b4da666ea58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126747.793261:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789126747.793264:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789126747.793279:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99423d256000 10000000:01000000:2.0:1789126747.793282:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789126747.793285:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789126747.793287:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789126747.793300:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793315:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793321:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.793333:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641920:0@lo:101: 00000100:00100000:2.0:1789126747.793358:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.793366:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3fa85 going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.793383:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276641920 00000100:00100000:2.0:1789126747.793387:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276641920 00000100:00100000:2.0:1789126747.793403:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789126747.793408:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deabcd83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+11:7441:x1876035276641920:12345-0@lo:101: 00010000:00010000:2.0:1789126747.793414:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126747.793422:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011252344/0xa840b4da666ea5a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea59a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793433:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011252344/0xa840b4da666ea5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea59a expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793439:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011252344/0xa840b4da666ea5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea59a expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793445:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011252344, rc 0) 00000100:00100000:2.0:1789126747.793471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deabcd83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276641920:12345-0@lo:101: Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.793476:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789126747.793498:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276641920:0@lo:101: 00010000:00010000:2.0:1789126747.793513:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126747.793520:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126747.793621:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642048:0@lo:501: 00000100:00100000:2.0:1789126747.793673:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.793682:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3fa85 going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.793699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642048 00000100:00100000:2.0:1789126747.793703:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642048 00000100:00100000:2.0:1789126747.793718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126747.793723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c81a32f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642048:12345-0@lo:501: 00000100:00100000:2.0:1789126747.793830:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c81a32f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642048:12345-0@lo:501: Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.793837:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126747.793861:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642048:0@lo:501: 00000100:00100000:2.0:1789126747.793886:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642176:0@lo:503: 00000100:00100000:2.0:1789126747.793925:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.793933:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3fa85 going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.793952:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642176 00000100:00100000:2.0:1789126747.793956:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642176 00000100:00100000:2.0:1789126747.793971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789126747.793976:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000621903fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642176:12345-0@lo:503: 00000100:00100000:2.0:1789126747.794057:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000621903fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642176:12345-0@lo:503: Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.794064:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789126747.794102:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642176:0@lo:503: 00000040:00080000:2.0:1789126747.794387:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789126747.794468:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642304:0@lo:502: 00000100:00100000:2.0:1789126747.794503:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.794512:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fc8415a going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.794531:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642304 00000100:00100000:2.0:1789126747.794535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642304 00000100:00100000:2.0:1789126747.794552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789126747.794557:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ce40b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642304:12345-0@lo:502: 00000100:00100000:2.0:1789126747.794630:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ce40b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642304:12345-0@lo:502: Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.794637:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789126747.794689:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642304:0@lo:502: 00000040:00080000:2.0:1789126747.794918:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789126747.794942:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789126747.794957:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789126747.794971:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789126747.794985:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789126747.794997:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789126747.795012:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789126747.795025:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789126747.795039:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789126747.795052:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789126747.795065:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789126747.795078:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789126747.795090:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789126747.795103:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789126747.795115:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789126747.795139:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789126747.795159:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789126747.795171:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789126747.795182:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789126747.795194:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789126747.795206:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789126747.795219:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789126747.795232:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789126747.795251:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642432:0@lo:502: 00000100:00100000:2.0:1789126747.795299:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126747.795310:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fc8415a going to sleep for 11 seconds 00000100:00100000:2.0:1789126747.795334:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642432 00000100:00100000:2.0:1789126747.795338:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642432 00000100:00100000:2.0:1789126747.795355:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789126747.795359:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d16ddc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642432:12345-0@lo:502: 00000100:00100000:2.0:1789126747.795428:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d16ddc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642432:12345-0@lo:502: Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126747.795435:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789126747.795464:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642432:0@lo:502: 00000040:00080000:2.0:1789126747.795499:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789126747.795506:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1789126747.802383:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126747.802474:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126747.802477:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789126747.802487:0:7453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789126747.802491:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789126747.802509:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000071ec1078) 00000020:00000080:3.0:1789126747.802538:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789126747.802546:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789126747.806050:0:7453:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789126747.806072:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea5af 00000020:00000080:2.0:1789126747.815086:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789126747.815108:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126747.815124:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126747.815127:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789126747.815134:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789126747.815142:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126747.815143:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789126747.815150:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789126747.815186:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003f37325a) 00000020:00000080:2.0:1789126747.815701:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789126747.815711:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789126747.815713:0:7453:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789126747.815716:0:7453:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789126747.815726:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789126747.816108:0:7453:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039e78495 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789126747.816126:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000001c54c030) 00000020:00000080:2.0:1789126747.816136:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789126747.816223:0:7453:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789126747.816230:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea5c4 00000020:00000080:2.0:1789126747.816389:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789126747.816397:0:7453:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789126747.816402:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa840b4da666ea5cb 00080000:01000000:2.0:1789126747.816409:0:7453:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789126747.816413:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea5d2 00080000:10000000:3.0:1789126747.819921:0:7453:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789126747.820483:0:7453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789126748.041920:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789126748.042416:0:7453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789126748.044525:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789126748.045445:0:7453:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789126748.075598:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789126748.075625:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126748.075632:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126748.075635:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789126748.075638:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126748.075643:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126748.075645:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789126748.075675:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789126748.075680:0:7453:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:0.0:1789126748.075705:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789126748.075730:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000019daca3e) 00000020:00000080:0.0:1789126748.075751:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789126748.075756:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789126748.075831:0:7453:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789126748.075836:0:7453:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789126748.075841:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea5e0 00010000:00080000:0.0:1789126748.075868:0:7453:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b5fafc5e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789126748.079868:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789126748.083971:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126748.083986:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789126748.084022:0:7453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789126748.084052:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea5e7 00000100:00080000:0.0:1789126748.084061:0:7453:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789126748.084066:0:7453:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b5fafc5e using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126748.084094:0:7453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000bda85b6 x1876035276642560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789126748.084123:0:7453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789126748.084192:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276642688:0@lo:400: 00000100:00100000:1.0:1789126748.084713:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276642560:0@lo:38: 00000100:00100000:1.0:1789126748.084760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789126748.084875:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126748.084879:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.084881:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789126748.084885:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789126748.084887:0:7453:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789126748.084889:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789126748.084890:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789126748.084891:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789126748.084894:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.084895:0:7453:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789126748.084897:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126748.084901:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.084902:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789126748.084906:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789126748.084942:0:7453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789126748.084958:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126748.084960:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.084962:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789126748.084964:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126748.084967:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.084968:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789126748.084971:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789126748.084972:0:7453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789126748.084997:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126748.084999:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126748.085000:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789126748.085003:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1789126748.085109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276642816:0@lo:400: 00000100:00100000:1.0:1789126748.085138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.085166:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642816 00000100:00100000:1.0:1789126748.085172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642816 00000100:00100000:1.0:1789126748.085205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789126748.085212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a257e6a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276642816:12345-0@lo:400: 00000100:00100000:1.0:1789126748.085288:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a257e6a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276642816:12345-0@lo:400: Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.085296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789126748.085529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126748.085567:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642688 00000100:00100000:0.0:1789126748.085570:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642688 00000020:01000000:2.0:1789126748.085721:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1789126748.085750:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789126748.085762:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.085773:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000126b4295/0xa840b4da666ea59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126748.085781:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99423d256000 from 1 10000000:01000000:2.0:1789126748.085784:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789126748.085809:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.085817:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.085825:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126748.085844:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642944:0@lo:101: 00000100:00100000:2.0:1789126748.085871:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.085885:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3a4398 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.086477:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642944 00000100:00100000:1.0:1789126748.086482:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642944 00000100:00100000:3.0:1789126748.086584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276642560 00000100:00100000:3.0:1789126748.086597:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276642560 00000100:00100000:3.0:1789126748.086616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126748.086621:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b08bbef1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276642560:12345-0@lo:38: 00010000:00080000:3.0:1789126748.086640:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1789126748.086683:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea5f5 00000004:00100000:3.0:1789126748.086695:0:6517:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789126748.086700:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:2.0:1789126748.086868:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000b7522d7 x1876035276642816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126748.086881:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276642816:0@lo:400: 00000100:00100000:1.0:1789126748.088363:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789126748.088445:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2cbde1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:3642:x1876035276642688:12345-0@lo:400: 00000100:00100000:1.0:1789126748.088522:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2cbde1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:3642:x1876035276642688:12345-0@lo:400: Request processed in 83us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.088529:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789126748.088556:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789126748.088563:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f7320d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+12:7441:x1876035276642944:12345-0@lo:101: 00010000:00010000:1.0:1789126748.088718:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126748.088734:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea5ee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.088757:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.088767:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.088775:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000338d00ed, rc 0) 00000100:00100000:1.0:1789126748.088823:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f7320d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:7441:x1876035276642944:12345-0@lo:101: Request processed in 261us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.088829:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789126748.088885:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276642688:0@lo:400: 00000100:00100000:1.0:1789126748.089790:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005217ff18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276642944:0@lo:101: 00010000:00010000:1.0:1789126748.089876:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.089887:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126748.091431:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643072:0@lo:256: 00000100:00100000:1.0:1789126748.091500:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.091543:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a91899a8 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.091568:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643072 00000100:00100000:1.0:1789126748.091573:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643072 00000100:00100000:1.0:1789126748.091607:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789126748.091614:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eb7978b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:7441:x1876035276643072:12345-0@lo:256: 20000000:01000000:1.0:1789126748.091630:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789126748.091672:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789126748.091676:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789126748.091757:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eb7978b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:7441:x1876035276643072:12345-0@lo:256: Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.091764:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789126748.091873:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643072:0@lo:256: 10000000:01000000:1.0:1789126748.092796:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789126748.092888:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.092899:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126748.092918:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 1 10000000:01000000:1.0:1789126748.092922:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126748.092959:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.093533:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.093544:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126748.093562:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643200:0@lo:101: 00000100:00100000:1.0:1789126748.093606:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.093634:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a91899a8 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.093668:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643200 00000100:00100000:1.0:1789126748.093673:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643200 00000100:00100000:1.0:1789126748.093703:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789126748.093709:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f648725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:7441:x1876035276643200:12345-0@lo:101: 00010000:00010000:1.0:1789126748.093720:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126748.093731:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea603 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.093754:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea603 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.093763:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea603 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.093771:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006263be09, rc 0) 00000100:00100000:1.0:1789126748.094072:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f648725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643200:12345-0@lo:101: Request processed in 362us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.094141:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789126748.095377:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643200:0@lo:101: 00010000:00010000:2.0:1789126748.095396:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.095407:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126748.095498:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643328:0@lo:501: 00000100:00100000:2.0:1789126748.095535:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.095573:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037ef175f going to sleep for 11 seconds 00000100:00100000:0.0:1789126748.096410:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643328 00000100:00100000:0.0:1789126748.096417:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643328 00000100:00100000:0.0:1789126748.096446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789126748.096452:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000471892bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643328:12345-0@lo:501: 00000100:00100000:0.0:1789126748.096554:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000471892bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643328:12345-0@lo:501: Request processed in 102us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.096561:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789126748.096824:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643328:0@lo:501: 00000100:00100000:0.0:1789126748.096859:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643456:0@lo:503: 00000100:00100000:0.0:1789126748.096897:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126748.096906:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b8324a4 going to sleep for 11 seconds 00000100:00100000:0.0:1789126748.096923:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643456 00000100:00100000:0.0:1789126748.096926:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643456 00000100:00100000:0.0:1789126748.096941:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789126748.096945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f37fe3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643456:12345-0@lo:503: 00000040:00080000:0.0:1789126748.096976:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789126748.097008:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f37fe3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643456:12345-0@lo:503: Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.097014:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789126748.097043:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643456:0@lo:503: 00000040:00080000:0.0:1789126748.097962:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126748.098014:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789126748.098088:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126748.102186:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789126748.104397:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789126748.104438:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126748.104455:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.104468:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126748.104524:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789126748.104527:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99423d256000 10000000:01000000:3.0:1789126748.104530:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99423d256000 10000000:01000000:3.0:1789126748.104534:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789126748.104539:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99423d256000 from 1 10000000:01000000:3.0:1789126748.104541:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789126748.104571:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.104579:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.104598:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126748.104630:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643584:0@lo:101: 00000100:00100000:3.0:1789126748.104707:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126748.104738:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbdbd47f going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.105126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643584 00000100:00100000:1.0:1789126748.105132:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643584 00000100:00100000:1.0:1789126748.105167:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789126748.105174:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d4ce28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:7441:x1876035276643584:12345-0@lo:101: 00010000:00010000:1.0:1789126748.105186:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126748.105197:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020301ca6/0xa840b4da666ea618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea611 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.105216:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020301ca6/0xa840b4da666ea618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea611 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.105225:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020301ca6/0xa840b4da666ea618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea611 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126748.105246:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020301ca6, rc 0) 00000100:00100000:1.0:1789126748.105290:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d4ce28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643584:12345-0@lo:101: Request processed in 116us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.105297:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789126748.105715:0:6517:0:(import.c:65:import_set_state_nolock()) 0000000050c6a568 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789126748.105758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b08bbef1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276642560:12345-0@lo:38: Request processed in 19136us (20998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.105778:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789126748.105906:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789126748.105914:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789126748.105920:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789126748.105925:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789126748.105927:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000b5fafc5e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789126748.105945:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276642560:0@lo:38: 00000100:00100000:3.0:1789126748.106054:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643584:0@lo:101: 00010000:00010000:3.0:1789126748.106067:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.106076:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126748.106154:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643712:0@lo:501: 00000100:00100000:3.0:1789126748.106179:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126748.106198:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbdbd47f going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.106848:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643712 00000100:00100000:1.0:1789126748.106861:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643712 00000100:00100000:1.0:1789126748.106888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789126748.106894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ce5de3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643712:12345-0@lo:501: 00000100:00100000:1.0:1789126748.106998:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ce5de3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643712:12345-0@lo:501: Request processed in 104us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.107005:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789126748.107030:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643712:0@lo:501: 00000100:00100000:1.0:1789126748.107057:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643840:0@lo:503: 00000100:00100000:1.0:1789126748.107092:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.107108:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e51e0e3 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.107123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643840 00000100:00100000:1.0:1789126748.107127:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643840 00000100:00100000:1.0:1789126748.107140:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789126748.107145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000243f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643840:12345-0@lo:503: 00000100:00100000:1.0:1789126748.107208:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000243f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643840:12345-0@lo:503: Request processed in 63us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.107214:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789126748.107273:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643840:0@lo:503: 00000040:00080000:1.0:1789126748.107535:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789126748.107585:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643968:0@lo:502: 00000100:00100000:1.0:1789126748.108206:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.108224:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058eadf83 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.108350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276643968 00000100:00100000:1.0:1789126748.108354:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276643968 00000100:00100000:1.0:1789126748.108373:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789126748.108379:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e7fc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643968:12345-0@lo:502: 00000100:00100000:1.0:1789126748.108467:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e7fc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276643968:12345-0@lo:502: Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.108473:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789126748.108503:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276643968:0@lo:502: 00000100:00100000:2.0:1789126748.109034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276644096:0@lo:41: 00000100:00100000:2.0:1789126748.109072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789126748.112062:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789126748.112108:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789126748.112120:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789126748.112133:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789126748.112144:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789126748.112156:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789126748.112166:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789126748.112177:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789126748.112188:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789126748.112200:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789126748.112211:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789126748.112223:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789126748.112248:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789126748.112261:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789126748.112286:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789126748.112299:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789126748.112310:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789126748.112321:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789126748.112332:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789126748.112349:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789126748.112360:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789126748.112371:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789126748.112382:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789126748.112394:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789126748.112404:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789126748.112415:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789126748.112427:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789126748.112447:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789126748.112486:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276644224:0@lo:502: 00000100:00100000:1.0:1789126748.112550:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126748.112942:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644096 00000100:00100000:0.0:1789126748.112951:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644096 00000100:00100000:0.0:1789126748.113000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789126748.113007:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e8ca3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876035276644096:12345-0@lo:41: 00000004:00000024:0.0:1789126748.113037:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789126748.113083:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e8ca3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876035276644096:12345-0@lo:41: Request processed in 77us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.113090:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126748.113161:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276644096:0@lo:41: 00000100:00100000:3.0:1789126748.113239:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644224 00000100:00100000:3.0:1789126748.113243:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644224 00000100:00100000:3.0:1789126748.113281:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789126748.113287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000017a5f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276644224:12345-0@lo:502: 00000100:00100000:3.0:1789126748.113370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000017a5f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276644224:12345-0@lo:502: Request processed in 84us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126748.113376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789126748.113539:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058eadf83 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.113551:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276644224:0@lo:502: 00000040:00080000:1.0:1789126748.114226:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789126748.114247:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789126748.116066:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789126748.116081:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000b83fe75e) 00000020:00000080:1.0:1789126748.116100:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789126748.116187:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039e78495 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789126748.116190:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000039e78495 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789126748.116193:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000039e78495 3 00010000:00080000:1.0:1789126748.116219:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000087f6e02a@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126748.117714:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789126748.117887:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789126748.117919:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789126748.117927:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa840b4da666ea626 00000100:00080000:1.0:1789126748.117936:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126748.117940:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000087f6e02a using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126748.117973:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c8701e09 x1876035276644352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789126748.118000:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789126748.119793:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276644352:0@lo:38: 00000100:00100000:3.0:1789126748.119871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.120696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644352 00000100:00100000:2.0:1789126748.120706:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644352 00000100:00100000:2.0:1789126748.120747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126748.120752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc37153c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276644352:12345-0@lo:38: 00010000:00080000:2.0:1789126748.120776:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1789126748.120811:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa840b4da666ea62d 00000004:00100000:2.0:1789126748.120823:0:6513:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789126748.120857:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000dbf2c94d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126748.120912:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc37153c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876035276644352:12345-0@lo:38: Request processed in 158us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126748.120919:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789126748.120966:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8701e09 x1876035276644352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126748.120976:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789126748.120983:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789126748.120990:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789126748.120994:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789126748.120996:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000087f6e02a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789126748.121001:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8701e09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276644352:0@lo:38: 00000040:00080000:1.0:1789126748.126626:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789126748.128514:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789126748.128553:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789126748.128569:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.128581:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000ada6e2e2/0xa840b4da666ea611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789126748.128639:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789126748.128641:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789126748.128643:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789126748.128644:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789126748.128663:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789126748.128665:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789126748.128666:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789126748.128668:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789126748.128669:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789126748.128670:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789126748.128672:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789126748.128675:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789126748.128677:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789126748.128678:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789126748.128679:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789126748.128685:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789126748.128686:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789126748.128687:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789126748.128688:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789126748.128689:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789126748.128690:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789126748.128691:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789126748.128691:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789126748.128714:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789126748.128729:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276644480:0@lo:253: 00000100:00100000:0.0:1789126748.128790:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126748.128825:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000003445b859 going to sleep for 11 seconds 40000000:00080000:0.0:1789126748.129838:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1789126748.131739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644480 00000100:00100000:3.0:1789126748.131750:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644480 00000100:00100000:3.0:1789126748.131808:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789126748.131816:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000470226a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:7441:x1876035276644480:12345-0@lo:253: 20000000:01000000:3.0:1789126748.131858:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789126748.131870:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789126748.145806:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789126748.150564:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789126748.150583:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789126748.150803:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789126748.150809:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789126748.150826:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.150842:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.150849:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.150856:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.150890:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.150913:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 15 pid: 6507 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126748.150927:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276644608:0@lo:104: 00000100:00100000:2.0:1789126748.150984:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126748.151032:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.151040:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126748.151047:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276644736:0@lo:104: 00000100:00100000:2.0:1789126748.151065:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.151076:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009f8b539 going to sleep for 11 seconds 00000100:00100000:0.0:1789126748.151129:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644608 00000100:00100000:0.0:1789126748.151135:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644608 00000100:00100000:0.0:1789126748.151166:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644736 00000100:00100000:0.0:1789126748.151168:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644736 00000100:00100000:0.0:1789126748.151180:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126748.151186:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005217ff18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276644608:12345-0@lo:104: 00010000:00010000:0.0:1789126748.151197:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151259:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126748.151270:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005217ff18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276644608:12345-0@lo:104: Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.151278:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126748.151293:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789126748.151298:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000994562d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276644736:12345-0@lo:104: 00010000:00010000:0.0:1789126748.151312:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151342:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789126748.151351:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000994562d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276644736:12345-0@lo:104: Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.151357:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789126748.151371:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126748.151375:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151382:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075e90dda already unused, calling callback (000000002af92885) 10000000:00010000:0.0:1789126748.151385:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151392:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126748.151398:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126748.151404:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126748.151426:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151432:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126748.151444:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151450:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea5ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5fc expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151459:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126748.151461:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151476:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000917e9291 already unused, calling callback (000000002af92885) 10000000:00010000:0.0:1789126748.151478:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151484:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126748.151489:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126748.151494:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126748.151503:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151508:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126748.151511:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151517:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000917e9291/0xa840b4da666ea54d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea554 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126748.151529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126748.151530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126748.151531:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126748.151730:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b048c68 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276644608:0@lo:104: 00000100:00100000:2.0:1789126748.151738:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276644736:0@lo:104: 00010000:00010000:2.0:1789126748.151756:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.151821:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126748.151910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041bfc91c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276644864:0@lo:103: 00000100:00100000:1.0:1789126748.151940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.151977:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126748.151982:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2dc8e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276644992:0@lo:103: 00000100:00100000:1.0:1789126748.152004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126748.152158:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644864 00000100:00100000:3.0:1789126748.152163:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644864 00010000:00010000:3.0:1789126748.152178:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 16 pid: 6507 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126748.152204:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276644992 00000100:00100000:3.0:1789126748.152206:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276644992 00010000:00010000:3.0:1789126748.152215:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 17 pid: 6505 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126748.152234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789126748.152239:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053ec5a60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+17:3641:x1876035276644864:12345-0@lo:103: 00010000:00010000:3.0:1789126748.152248:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126748.152252:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 17 pid: 6507 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152259:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 17 pid: 6507 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152280:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000338d00ed/0xa840b4da666ea5fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea5ee expref: 17 pid: 6507 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152292:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126748.152333:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053ec5a60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+16:3641:x1876035276644864:12345-0@lo:103: Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126748.152339:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789126748.152358:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789126748.152363:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009590d52e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+15:3641:x1876035276644992:12345-0@lo:103: 00010000:00010000:3.0:1789126748.152370:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126748.152373:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152381:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152390:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071ff3209/0xa840b4da666ea554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea54d expref: 15 pid: 6505 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152398:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152405:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789126748.152416:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002708759s 00010000:00010000:3.0:1789126748.152419:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152425:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152430:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152436:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152441:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003021e0eb already unused, calling callback (0000000064ef3424) 00010000:00010000:3.0:1789126748.152448:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152454:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152464:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126748.152472:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126748.152492:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009590d52e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+14:3641:x1876035276644992:12345-0@lo:103: Request processed in 129us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126748.152498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789126748.152715:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2dc8e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276644992:0@lo:103: 00000100:00100000:1.0:1789126748.152723:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041bfc91c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276644864:0@lo:103: 00010000:00010000:2.0:1789126748.152778:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.152785:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126748.152791:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003021e0eb/0xa840b4da666ea634 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126748.155156:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000470226a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:7441:x1876035276644480:12345-0@lo:253: Request processed in 23336us (26361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126748.155169:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789126748.155478:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:7441:1876035276644480:0@lo:253: 10000000:01000000:0.0:1789126748.155492:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789126748.155495:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789126748.155497:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789126748.155499:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789126748.155509:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789126748.155510:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789126748.155511:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789126748.155513:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789126748.155514:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789126748.155515:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789126748.155516:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789126748.155518:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789126748.155529:0:7441:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789126748.169080:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789126748.169285:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789126748.170356:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789126748.170520:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789126748.171000:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789126748.171198:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789126748.179518:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789126748.180059:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789126748.180231:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789126748.180393:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789126748.180542:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789126748.181446:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789126748.194495:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789126748.196826:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789126748.196876:0:7466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876035276645120:0@lo:700: 00000100:00100000:3.0:1789126748.196935:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126748.196975:0:7466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac8105c2 going to sleep for 11 seconds 00000040:01000000:1.0:1789126748.197018:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789126748.197170:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645120 00000100:00100000:2.0:1789126748.197176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645120 00000100:00100000:2.0:1789126748.197220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789126748.197235:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a26393f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876035276645120:12345-0@lo:700: 00000100:00100000:1.0:1789126748.197610:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061e3ab0c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645248:0@lo:1000: 00000100:00100000:1.0:1789126748.197641:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126748.197691:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001b83cd1 going to sleep for 11 seconds 00000040:01000000:3.0:1789126748.198081:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789126748.198181:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789126748.198332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645248 00000100:00100000:2.0:1789126748.198337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645248 00000100:00100000:2.0:1789126748.198379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126748.198385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053ec5a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645248:12345-0@lo:1000: 00000100:00100000:2.0:1789126748.198454:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053ec5a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645248:12345-0@lo:1000: Request processed in 69us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126748.198461:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126748.198494:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061e3ab0c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645248:0@lo:1000: 00000040:01000000:2.0:1789126748.198517:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789126748.198535:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645376:0@lo:700: 00000100:00100000:2.0:1789126748.198558:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.198571:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bd2be94 going to sleep for 11 seconds 00000004:00000080:3.0:1789126748.199200:0:7441:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789126748.199208:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1789126748.199356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645376 00000100:00100000:1.0:1789126748.199361:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645376 00000100:00100000:1.0:1789126748.199385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789126748.199390:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b048c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645376:12345-0@lo:700: 00000100:00100000:1.0:1789126748.199434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b048c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645376:12345-0@lo:700: Request processed in 45us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.199441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789126748.199638:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645376:0@lo:700: 00000100:00100000:2.0:1789126748.199702:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876035276645504:0@lo:900: 00000100:00100000:2.0:1789126748.199725:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.199748:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bd2be94 going to sleep for 11 seconds 00000100:00100000:1.0:1789126748.200476:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645504 00000100:00100000:1.0:1789126748.200481:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645504 00000100:00100000:1.0:1789126748.200516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789126748.200522:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef016a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876035276645504:12345-0@lo:900: 00000100:00100000:1.0:1789126748.200563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef016a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876035276645504:12345-0@lo:900: Request processed in 41us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126748.200575:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00080000:0.0:1789126748.200735:0:7465:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789126748.200739:0:7465:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00080000:2.0:1789126748.200987:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f08783b x1876035276645504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789126764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126748.200998:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876035276645504:0@lo:900: 00000100:00100000:2.0:1789126748.201073:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645632:0@lo:1000: 00000100:00100000:2.0:1789126748.201100:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.201114:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070108bad going to sleep for 11 seconds 00000040:00080000:3.0:1789126748.201484:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789126748.202695:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1789126748.203577:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645632 00000100:00100000:0.0:1789126748.203593:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645632 00000100:00100000:0.0:1789126748.203637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789126748.203644:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050bfbab0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645632:12345-0@lo:1000: 00000100:00100000:0.0:1789126748.203752:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050bfbab0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645632:12345-0@lo:1000: Request processed in 108us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.203760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126748.203973:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645632:0@lo:1000: 00000004:00080000:2.0:1789126748.204023:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000bd2be94 with version 0 00000020:00100000:2.0:1789126748.204040:0:7467:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789126748.204045:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000f08783b x1876035276645888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126748.204061:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645888:0@lo:1000: 00000100:00100000:2.0:1789126748.204089:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.204104:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946aee98 going to sleep for 11 seconds 00000100:00100000:0.0:1789126748.204148:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276645888 00000100:00100000:0.0:1789126748.204152:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276645888 00000100:00100000:0.0:1789126748.204177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126748.204182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000375e0626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645888:12345-0@lo:1000: 00000001:00080000:2.0:1789126748.206171:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789126748.206325:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000375e0626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276645888:12345-0@lo:1000: Request processed in 2140us (2232us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789126748.206339:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:0.0:1789126748.206484:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1789126748.209789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a26393f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876035276645120:12345-0@lo:700: Request processed in 12556us (12849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.209806:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1789126748.210118:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789126748.210123:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789126748.210136:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276645888:0@lo:1000: 00000100:00100000:2.0:1789126748.210215:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276646016:0@lo:1000: 00000100:00100000:2.0:1789126748.210261:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.210307:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d6c22ab going to sleep for 11 seconds 00010000:00080000:1.0:1789126748.210451:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004aaa18ff x1876035276645120/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789126764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126748.210462:0:7466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004aaa18ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876035276645120:0@lo:700: 40000000:02000000:1.0:1789126748.210469:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:3.0:1789126748.214578:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789126748.214699:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789126748.214911:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789126748.215101:0:7441:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789126748.218100:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789126748.218219:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789126748.218349:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789126748.218473:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789126748.218605:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789126748.218808:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789126748.218927:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789126748.219051:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789126748.219174:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789126748.219307:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789126748.219420:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789126748.219532:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789126748.219681:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789126748.219796:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789126748.219918:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789126748.220050:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:0.0:1789126748.223841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646016 00000100:00100000:0.0:1789126748.223852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646016 00000100:00100000:0.0:1789126748.223908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789126748.223916:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e96a2d3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276646016:12345-0@lo:1000: 00000100:00100000:0.0:1789126748.224034:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e96a2d3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035276646016:12345-0@lo:1000: Request processed in 119us (13773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126748.224053:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789126748.224198:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876035276646016:0@lo:1000: 00000040:00080000:0.0:1789126748.224224:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789126748.225864:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001bbee8ed with version 1 00100000:10000000:3.0:1789126748.226073:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789126748.232336:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789126748.232527:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789126748.232774:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789126748.232888:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789126748.233021:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789126748.233139:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789126748.233289:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789126748.235451:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789126748.236581:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789126748.239036:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789126748.239158:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000040:00080000:1.0:1789126748.239569:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789126748.239695:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007e8f79bb version 1 rpc_version 1 00000020:00100000:2.0:1789126748.239728:0:7456:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789126748.239738:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000f08783b x1876035276646272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126748.239768:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1876035276646272:0@lo:1000: 00000100:00100000:2.0:1789126748.239835:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126748.239891:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946aee98 going to sleep for 11 seconds 00000100:00100000:2.0:1789126748.239974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646272 00000100:00100000:2.0:1789126748.239981:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646272 00000100:00100000:2.0:1789126748.240019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126748.240026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057be3b76 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876035276646272:12345-0@lo:1000: 00000040:00080000:0.0:1789126748.240360:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789126748.240473:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1789126748.240890:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789126748.241050:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789126748.241187:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789126748.241957:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789126748.245056:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789126748.247486:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000040:00080000:1.0:1789126748.248954:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789126748.249029:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789126748.249035:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:2.0:1789126748.249945:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057be3b76 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876035276646272:12345-0@lo:1000: Request processed in 9915us (10105us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789126748.249960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789126748.250035:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789126748.250040:0:7456:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789126748.250055:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f08783b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1876035276646272:0@lo:1000: 00000001:00080000:3.0:1789126748.255921:0:7441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789126748.255964:0:7441:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb30541ccb988 00100000:10000000:3.0:1789126748.255971:0:7441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789126748.256636:0:7441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789126748.256694:0:7441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789126748.256712:0:7441:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789126748.256728:0:7441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789126748.257369:0:7441:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126748.257535:0:7441:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789126748.600505:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126749.614698:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126750.634935:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126751.663399:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126752.682852:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126753.453211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8318e52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276646400:0@lo:400: 00000100:00100000:2.0:1789126753.453767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126753.461185:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126753.461216:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096a24d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276646528:0@lo:400: 00000100:00100000:2.0:1789126753.461327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126753.461411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efe03634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276646656:0@lo:400: 00000100:00100000:2.0:1789126753.461444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126753.461466:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126753.461473:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000488c56db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276646784:0@lo:400: 00000100:00100000:2.0:1789126753.461497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126753.461538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646400 00000100:00100000:2.0:1789126753.461547:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646400 00000100:00100000:2.0:1789126753.464150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789126753.464182:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd9d4af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+13:3639:x1876035276646400:12345-0@lo:400: 00000100:00100000:2.0:1789126753.464396:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd9d4af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+13:3639:x1876035276646400:12345-0@lo:400: Request processed in 207us (10607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126753.464474:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789126753.464537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646528 00000100:00100000:2.0:1789126753.464547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646528 00000100:00100000:2.0:1789126753.464598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646784 00000100:00100000:2.0:1789126753.464602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646784 00000100:00100000:2.0:1789126753.464617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126753.464624:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b5cd4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276646528:12345-0@lo:400: 00000100:00100000:2.0:1789126753.466698:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b5cd4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276646528:12345-0@lo:400: Request processed in 2063us (5360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126753.466714:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126753.466762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789126753.466776:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1d3d6c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276646784:12345-0@lo:400: 00000100:00100000:2.0:1789126753.467563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1d3d6c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276646784:12345-0@lo:400: Request processed in 789us (6062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126753.467572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789126753.467606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646656 00000100:00100000:2.0:1789126753.467615:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646656 00000100:00100000:2.0:1789126753.467758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789126753.467766:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052250347 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276646656:12345-0@lo:400: 00000100:00100000:2.0:1789126753.467817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052250347 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276646656:12345-0@lo:400: Request processed in 53us (6373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126753.467823:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789126753.467880:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000096a24d00 x1876035276646528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126753.467897:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096a24d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276646528:0@lo:400: 00000100:00100000:2.0:1789126753.467910:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8318e52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276646400:0@lo:400: 00000100:00100000:2.0:1789126753.471223:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126753.471306:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276646912:0@lo:41: 00000100:00100000:2.0:1789126753.471637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126753.471804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276646912 00000100:00100000:0.0:1789126753.471814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276646912 00000100:00100000:0.0:1789126753.471879:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126753.471889:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8318e52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276646912:12345-0@lo:41: 00000004:00000024:0.0:1789126753.471936:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789126753.472096:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8318e52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276646912:12345-0@lo:41: Request processed in 208us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126753.472104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789126753.472928:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276646912:0@lo:41: 00010000:00080000:1.0:1789126753.474892:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000488c56db x1876035276646784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126753.474917:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000488c56db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276646784:0@lo:400: 00000100:00100000:1.0:1789126753.474979:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efe03634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276646656:0@lo:400: 00010000:00010000:0.0:1789126753.707734:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126754.730892:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126755.755408:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789126755.811353:0:7711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789126756.783792:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789126756.957995:0:7764:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126756.958353:0:7764:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789126757.041034:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789126757.041042:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99423d256000 from 4 10000000:01000000:3.0:1789126757.041047:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789126757.041099:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.041111:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.041121:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126757.041242:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b69c69ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647040:0@lo:101: 00000100:00100000:0.0:1789126757.041319:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.041371:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328e5cbc going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.041425:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647040 00000100:00100000:3.0:1789126757.041433:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647040 00000100:00100000:3.0:1789126757.041488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789126757.041497:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006da96798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+13:6509:x1876035276647040:12345-0@lo:101: 00010000:00010000:3.0:1789126757.041511:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126757.041522:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096de303c/0xa840b4da666ea642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea63b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.041543:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096de303c/0xa840b4da666ea642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea63b expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.041553:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096de303c/0xa840b4da666ea642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea63b expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.041561:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096de303c, rc 0) 00000100:00100000:3.0:1789126757.041607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006da96798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:6509:x1876035276647040:12345-0@lo:101: Request processed in 112us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.041613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789126757.041724:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b69c69ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647040:0@lo:101: 00010000:00010000:0.0:1789126757.041738:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126757.041745:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126757.041793:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061039acc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647168:0@lo:256: 00000100:00100000:0.0:1789126757.041824:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.041853:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328e5cbc going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.042082:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647168 00000100:00100000:3.0:1789126757.042087:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647168 00000100:00100000:3.0:1789126757.042117:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789126757.042123:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7d01cbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:6509:x1876035276647168:12345-0@lo:256: 20000000:01000000:3.0:1789126757.042137:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789126757.042153:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789126757.042156:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789126757.042245:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7d01cbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:6509:x1876035276647168:12345-0@lo:256: Request processed in 122us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.042251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789126757.042286:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061039acc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647168:0@lo:256: 10000000:01000000:3.0:1789126757.042326:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789126757.042332:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042339:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000000ce22f52/0xa840b4da666ea63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126757.042347:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789126757.042349:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994212236800 from 21 10000000:01000000:3.0:1789126757.042351:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789126757.042368:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042375:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042382:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126757.042392:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647296:0@lo:101: 00000100:00100000:3.0:1789126757.042415:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126757.042428:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.042439:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647296 00000100:00100000:3.0:1789126757.042443:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647296 00000100:00100000:3.0:1789126757.042459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789126757.042464:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ab85718 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:6509:x1876035276647296:12345-0@lo:101: 00010000:00010000:3.0:1789126757.042470:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126757.042477:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080c09ed7/0xa840b4da666ea650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea649 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042498:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080c09ed7/0xa840b4da666ea650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea649 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042506:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080c09ed7/0xa840b4da666ea650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea649 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042513:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080c09ed7, rc 0) 00000100:00100000:3.0:1789126757.042543:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ab85718 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647296:12345-0@lo:101: Request processed in 79us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.042549:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789126757.042576:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647296:0@lo:101: 00010000:00010000:3.0:1789126757.042585:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.042591:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126757.042641:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647424:0@lo:501: 00000100:00100000:3.0:1789126757.042685:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126757.042697:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.042708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647424 00000100:00100000:3.0:1789126757.042711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647424 00000100:00100000:3.0:1789126757.042731:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789126757.042735:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080adff6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647424:12345-0@lo:501: 00000100:00100000:3.0:1789126757.042840:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080adff6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647424:12345-0@lo:501: Request processed in 104us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.042846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789126757.042880:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647424:0@lo:501: 00000100:00100000:3.0:1789126757.042905:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647552:0@lo:503: 00000100:00100000:3.0:1789126757.042940:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126757.042953:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.042963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647552 00000100:00100000:3.0:1789126757.042966:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647552 00000100:00100000:3.0:1789126757.042981:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789126757.042986:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f6455f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647552:12345-0@lo:503: 00000100:00100000:3.0:1789126757.043056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f6455f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647552:12345-0@lo:503: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.043062:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789126757.043099:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647552:0@lo:503: 00000100:00100000:1.0:1789126757.050694:0:7770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7770:1876035276647680:0@lo:502: 00000100:00100000:1.0:1789126757.050771:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.050807:0:7770:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7666465 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.051125:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647680 00000100:00100000:3.0:1789126757.051132:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647680 00000100:00100000:3.0:1789126757.051578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789126757.051588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005a994ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7770:x1876035276647680:12345-0@lo:502: 00000100:00100000:3.0:1789126757.051729:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005a994ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:7770:x1876035276647680:12345-0@lo:502: Request processed in 143us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.051736:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789126757.051820:0:7770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c11cd71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7770:1876035276647680:0@lo:502: 00000100:00100000:0.0:1789126757.051866:0:7770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7770:1876035276647808:0@lo:502: 00000100:00100000:0.0:1789126757.051900:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.052193:0:7770:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdccee91 going to sleep for 11 seconds 00000100:00100000:2.0:1789126757.052229:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647808 00000100:00100000:2.0:1789126757.052234:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647808 00000100:00100000:2.0:1789126757.052257:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789126757.052261:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3654c3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:7770:x1876035276647808:12345-0@lo:502: 00000100:00100000:2.0:1789126757.052381:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3654c3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:7770:x1876035276647808:12345-0@lo:502: Request processed in 118us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126757.052387:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789126757.053463:0:7770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7770:1876035276647808:0@lo:502: 00000040:00080000:0.0:1789126757.053492:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789126757.054548:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789126757.054575:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126757.054584:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.054597:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000ee2eff90/0xa840b4da666ea649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126757.054619:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789126757.054621:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994212236800 from 4 10000000:01000000:3.0:1789126757.054625:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789126757.054678:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.054685:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.054693:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126757.054712:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647936:0@lo:101: 00000100:00100000:3.0:1789126757.054771:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126757.054809:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdaee782 going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.054866:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276647936 00000100:00100000:0.0:1789126757.054873:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276647936 00000100:00100000:0.0:1789126757.054917:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789126757.054980:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c434e804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276647936:12345-0@lo:101: 00010000:00010000:0.0:1789126757.055109:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126757.055121:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ab3aa99/0xa840b4da666ea65e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea657 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126757.055142:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ab3aa99/0xa840b4da666ea65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea657 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126757.055160:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ab3aa99/0xa840b4da666ea65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea657 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126757.055169:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ab3aa99, rc 0) 00000100:00100000:0.0:1789126757.055220:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c434e804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276647936:12345-0@lo:101: Request processed in 243us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126757.055227:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789126757.061214:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276647936:0@lo:101: 00010000:00010000:3.0:1789126757.061241:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126757.061253:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126757.061517:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648064:0@lo:256: 00000100:00100000:3.0:1789126757.061574:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126757.061614:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdaee782 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.061684:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648064 00000100:00100000:1.0:1789126757.061691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648064 00000100:00100000:1.0:1789126757.061729:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789126757.061735:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c66c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276648064:12345-0@lo:256: 20000000:01000000:1.0:1789126757.061752:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789126757.061765:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789126757.061771:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789126757.061836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c66c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276648064:12345-0@lo:256: Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.061844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789126757.061873:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a196fe4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648064:0@lo:256: 10000000:01000000:1.0:1789126757.061908:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789126757.061913:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.061921:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000009d9d7d81/0xa840b4da666ea657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126757.061929:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789126757.061931:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789126757.061933:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789126757.061951:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.061957:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.061965:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126757.061974:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648192:0@lo:101: 00000100:00100000:1.0:1789126757.061995:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.062006:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f94cb704 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.062017:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648192 00000100:00100000:1.0:1789126757.062020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648192 00000100:00100000:1.0:1789126757.062037:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126757.062047:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ecc2af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276648192:12345-0@lo:101: 00010000:00010000:1.0:1789126757.062055:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126757.062064:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071ff3209/0xa840b4da666ea66c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea665 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.062079:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071ff3209/0xa840b4da666ea66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea665 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.062087:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071ff3209/0xa840b4da666ea66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea665 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.062095:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071ff3209, rc 0) 00000100:00100000:1.0:1789126757.062115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ecc2af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276648192:12345-0@lo:101: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.062120:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126757.062141:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648192:0@lo:101: 00010000:00010000:1.0:1789126757.062149:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.062155:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126757.062197:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648320:0@lo:501: 00000100:00100000:1.0:1789126757.062230:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.062240:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f94cb704 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.062249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648320 00000100:00100000:1.0:1789126757.062251:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648320 00000100:00100000:1.0:1789126757.062266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789126757.062270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072a1794b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276648320:12345-0@lo:501: 00000100:00100000:1.0:1789126757.062375:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072a1794b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276648320:12345-0@lo:501: Request processed in 104us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.062381:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789126757.062415:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648320:0@lo:501: 00000100:00100000:1.0:1789126757.062434:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648448:0@lo:503: 00000100:00100000:1.0:1789126757.062467:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.062478:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f94cb704 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.062487:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648448 00000100:00100000:1.0:1789126757.062489:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648448 00000100:00100000:1.0:1789126757.062505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789126757.062509:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cd59749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276648448:12345-0@lo:503: 00000100:00100000:1.0:1789126757.062569:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cd59749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276648448:12345-0@lo:503: Request processed in 59us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.062575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789126757.062606:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276648448:0@lo:503: 00000100:00100000:1.0:1789126757.062761:0:7772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7772:1876035276648576:0@lo:502: 00000100:00100000:1.0:1789126757.062788:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.062801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648576 00000100:00100000:1.0:1789126757.062804:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648576 00000100:00100000:1.0:1789126757.062819:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789126757.062823:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078777e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:7772:x1876035276648576:12345-0@lo:502: 00000100:00100000:1.0:1789126757.062884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078777e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:7772:x1876035276648576:12345-0@lo:502: Request processed in 60us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.062890:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789126757.062911:0:7772:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ee16eb8 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.062923:0:7772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7772:1876035276648576:0@lo:502: 00000020:01000000:1.0:1789126757.062940:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126757.062948:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126757.062950:0:7772:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789126757.062954:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789126757.062957:0:7772:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:1.0:1789126757.062974:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789126757.062986:0:7772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000066f3585e) 00000020:00000080:1.0:1789126757.063000:0:7772:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789126757.063004:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789126757.063062:0:7772:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789126757.063066:0:7772:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789126757.063072:0:7772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea67a 00010000:00080000:1.0:1789126757.063110:0:7772:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000119874ce@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126757.064761:0:7772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789126757.076862:0:7772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789126757.076878:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789126757.076918:0:7772:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789126757.076954:0:7772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea681 00000100:00080000:1.0:1789126757.076964:0:7772:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126757.076969:0:7772:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000119874ce using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126757.077001:0:7772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026aa9972 x1876035276648704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789126757.077025:0:7772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789126757.079507:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276648704:0@lo:38: 00000100:00100000:3.0:1789126757.079584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.080231:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648704 00000100:00100000:0.0:1789126757.080577:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648704 00000100:00100000:0.0:1789126757.080624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126757.080632:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f629097 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276648704:12345-0@lo:38: 00010000:00080000:0.0:1789126757.080685:0:6518:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:0.0:1789126757.080721:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea688 00000004:00100000:0.0:1789126757.080736:0:6518:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789126757.080741:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:01000000:1.0:1789126757.081586:0:7772:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789126757.082568:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000587a62f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276648832:0@lo:400: 00000100:00100000:2.0:1789126757.082629:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.088561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276648960:0@lo:400: 00000100:00100000:2.0:1789126757.088633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.088731:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126757.088738:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051fc4a31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276649088:0@lo:400: 00000100:00100000:2.0:1789126757.088763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.088795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648832 00000100:00100000:2.0:1789126757.088802:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648832 00000100:00100000:2.0:1789126757.088839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649088 00000100:00100000:2.0:1789126757.088842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649088 00000100:00100000:2.0:1789126757.088856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789126757.088864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024453296 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276648832:12345-0@lo:400: 00000100:00100000:2.0:1789126757.088913:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024453296 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276648832:12345-0@lo:400: Request processed in 50us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126757.088928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789126757.088946:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126757.088951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059163561 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276649088:12345-0@lo:400: 00000100:00100000:2.0:1789126757.088984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059163561 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276649088:12345-0@lo:400: Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126757.088990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789126757.089026:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000587a62f x1876035276648832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126757.089040:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000587a62f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276648832:0@lo:400: 00010000:00080000:2.0:1789126757.089065:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000051fc4a31 x1876035276649088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126757.089074:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051fc4a31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276649088:0@lo:400: 00000100:00100000:3.0:1789126757.091847:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789126757.091863:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789126757.092489:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276648960 00000100:00100000:3.0:1789126757.092497:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276648960 00000100:00100000:3.0:1789126757.092619:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789126757.092628:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc7cbce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276648960:12345-0@lo:400: 00000100:00100000:3.0:1789126757.092733:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc7cbce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276648960:12345-0@lo:400: Request processed in 107us (4100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.092740:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126757.093270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276648960:0@lo:400: 00000020:01000000:1.0:1789126757.093577:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126757.093584:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126757.093587:0:7772:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789126757.093590:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126757.093594:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126757.093602:0:7772:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789126757.093606:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789126757.093608:0:7772:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789126757.093641:0:7772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7772:1876035276649216:0@lo:502: 00000100:00100000:1.0:1789126757.093723:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.093754:0:7772:0:(client.c:2715:ptlrpc_set_wait()) set 00000000769b5fd0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.093772:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649216 00000100:00100000:1.0:1789126757.093776:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649216 00000100:00100000:1.0:1789126757.093805:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789126757.093812:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aed38e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:7772:x1876035276649216:12345-0@lo:502: 00000100:00100000:1.0:1789126757.093915:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aed38e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:7772:x1876035276649216:12345-0@lo:502: Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126757.093922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789126757.093970:0:7772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7772:1876035276649216:0@lo:502: 00000020:01000000:1.0:1789126757.093991:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126757.093995:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126757.093996:0:7772:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789126757.094000:0:7772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789126757.094096:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789126757.094115:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789126757.094123:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.094133:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000338d00ed/0xa840b4da666ea665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126757.094143:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789126757.094145:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f0000 from 1 10000000:01000000:1.0:1789126757.094148:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789126757.094177:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.094185:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.094193:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789126757.095520:0:7777:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000e2049128 x1876035276649472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126757.095533:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b68ecd4 going to sleep for 0 seconds 00000100:00080000:0.0:1789126757.097185:0:6518:0:(import.c:65:import_set_state_nolock()) 0000000063b83bef : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789126757.097284:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f629097 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276648704:12345-0@lo:38: Request processed in 16650us (17699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126757.097295:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789126757.097761:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276649344:0@lo:101: 00000100:00100000:1.0:1789126757.097805:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.097843:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000769b5fd0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.098520:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789126757.098529:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789126757.098537:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789126757.098542:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789126757.098544:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000119874ce lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789126757.098559:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003b68ecd4): req@00000000e2049128 x1876035276649472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126757.098572:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026aa9972 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276648704:0@lo:38: 00000100:00100000:2.0:1789126757.099625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649344 00000100:00100000:2.0:1789126757.099635:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649344 00000100:00100000:2.0:1789126757.099712:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789126757.099720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b405b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276649344:12345-0@lo:101: 00010000:00010000:2.0:1789126757.099733:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126757.099749:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003021e0eb/0xa840b4da666ea696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea68f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126757.099774:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003021e0eb/0xa840b4da666ea696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126757.099792:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003021e0eb/0xa840b4da666ea696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126757.099800:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003021e0eb, rc 0) 00000100:00100000:2.0:1789126757.099855:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b405b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276649344:12345-0@lo:101: Request processed in 136us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126757.099862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789126757.099898:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6cc31b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276649600:0@lo:41: 00000100:00100000:2.0:1789126757.099932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.100039:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.100052:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b68ecd4 going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.100174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649600 00000100:00100000:3.0:1789126757.100179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649600 00000100:00100000:3.0:1789126757.100216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649472 00000100:00100000:3.0:1789126757.100219:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649472 00000100:00100000:3.0:1789126757.100232:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789126757.100238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051fc4a31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876035276649600:12345-0@lo:41: 00000004:00000024:3.0:1789126757.100263:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789126757.100300:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051fc4a31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876035276649600:12345-0@lo:41: Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.100317:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789126757.100339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789126757.100351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000587a62f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649472:12345-0@lo:1000: 00000100:00100000:3.0:1789126757.100536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000587a62f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649472:12345-0@lo:1000: Request processed in 184us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.100543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789126757.101958:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6cc31b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276649600:0@lo:41: 00000100:00100000:2.0:1789126757.102006:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276649472:0@lo:1000: 00000040:01000000:2.0:1789126757.102037:0:7777:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789126757.102076:0:7777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276649728:0@lo:1000: 00000100:00100000:2.0:1789126757.102121:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.102152:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d6c22ab going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.102859:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649728 00000100:00100000:0.0:1789126757.102867:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649728 00000100:00100000:0.0:1789126757.102911:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789126757.102919:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae181118 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649728:12345-0@lo:1000: 00000100:00100000:0.0:1789126757.103038:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae181118 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649728:12345-0@lo:1000: Request processed in 120us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126757.103046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126757.103368:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276649344:0@lo:101: 00010000:00010000:1.0:1789126757.103385:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.103407:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126757.103465:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276649856:0@lo:501: 00000100:00100000:1.0:1789126757.103494:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126757.103519:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000769b5fd0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126757.103538:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649856 00000100:00100000:1.0:1789126757.103542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649856 00000100:00100000:1.0:1789126757.103569:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789126757.103574:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b48a044a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276649856:12345-0@lo:501: 00000100:00100000:1.0:1789126757.103637:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b48a044a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276649856:12345-0@lo:501: Request processed in 62us (142us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126757.103644:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789126757.103704:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bee0cb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276649856:0@lo:501: 10000000:01000000:1.0:1789126757.103727:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789126757.103732:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126757.103739:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000cfc898f2/0xa840b4da666ea68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126757.107103:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276649728:0@lo:1000: 00000100:00100000:2.0:1789126757.107182:0:7777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276649984:0@lo:700: 00000100:00100000:2.0:1789126757.107244:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.107284:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d6c22ab going to sleep for 11 seconds 00000100:00100000:3.0:1789126757.107354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276649984 00000100:00100000:3.0:1789126757.107362:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276649984 00000100:00100000:3.0:1789126757.107421:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789126757.107430:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d23d52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649984:12345-0@lo:700: 00000100:00100000:3.0:1789126757.107484:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d23d52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276649984:12345-0@lo:700: Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126757.107491:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126757.107603:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276649984:0@lo:700: 00000100:00100000:2.0:1789126757.107816:0:7777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650112:0@lo:1000: 00000100:00100000:2.0:1789126757.107845:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.107870:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025254d9f going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.108058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276650112 00000100:00100000:0.0:1789126757.108063:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276650112 00000100:00100000:0.0:1789126757.108094:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789126757.108101:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017ae008d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276650112:12345-0@lo:1000: 00000100:00100000:0.0:1789126757.108161:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017ae008d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276650112:12345-0@lo:1000: Request processed in 61us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126757.108167:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789126757.108196:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650112:0@lo:1000: 00000004:00080000:0.0:1789126757.108242:0:7777:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005d6c22ab with version 0 00000020:00100000:0.0:1789126757.108255:0:7777:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789126757.108261:0:7777:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000027d29183 x1876035276650368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126757.108274:0:7777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650368:0@lo:1000: 00000100:00100000:0.0:1789126757.108298:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.108314:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328e5cbc going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.108336:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276650368 00000100:00100000:0.0:1789126757.108340:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276650368 00000100:00100000:0.0:1789126757.108364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789126757.108369:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc405fac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1876035276650368:12345-0@lo:1000: 00000001:00080000:2.0:1789126757.115574:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789126757.115589:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789126757.115768:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc405fac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7777:x1876035276650368:12345-0@lo:1000: Request processed in 7396us (7466us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789126757.115781:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789126757.115875:0:7777:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789126757.115880:0:7777:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789126757.115893:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650368:0@lo:1000: 00000100:00100000:2.0:1789126757.115970:0:7777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650496:0@lo:1000: 00000100:00100000:2.0:1789126757.116007:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126757.116035:0:7777:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a55830da going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.116483:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276650496 00000100:00100000:0.0:1789126757.116490:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276650496 00000100:00100000:0.0:1789126757.116532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789126757.116540:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efe03634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7777:x1876035276650496:12345-0@lo:1000: 00000100:00100000:0.0:1789126757.116607:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efe03634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7777:x1876035276650496:12345-0@lo:1000: Request processed in 68us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126757.116620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789126757.116868:0:7777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2049128 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7777:1876035276650496:0@lo:1000: 00000040:00080000:2.0:1789126757.116885:0:7777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789126757.116913:0:7777:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e223cdbc with version 1 00000004:00080000:0.0:1789126757.122333:0:7773:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000067556f19 version 1 rpc_version 1 00000020:00100000:0.0:1789126757.122374:0:7773:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789126757.122384:0:7773:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000027d29183 x1876035276650752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126757.122407:0:7773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7773:1876035276650752:0@lo:1000: 00000100:00100000:0.0:1789126757.122472:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126757.122500:0:7773:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b20f1405 going to sleep for 11 seconds 00000100:00100000:0.0:1789126757.122522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276650752 00000100:00100000:0.0:1789126757.122528:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276650752 00000100:00100000:0.0:1789126757.122584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789126757.122592:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061039acc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7773:x1876035276650752:12345-0@lo:1000: 00000040:00080000:2.0:1789126757.123911:0:7777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789126757.123974:0:7777:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789126757.123980:0:7777:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1789126757.127862:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789126757.128054:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061039acc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7773:x1876035276650752:12345-0@lo:1000: Request processed in 5459us (5579us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789126757.128069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789126757.128225:0:7773:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789126757.128230:0:7773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789126757.128246:0:7773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7773:1876035276650752:0@lo:1000: 00010000:00010000:2.0:1789126757.807234:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126758.578292:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276650880:0@lo:41: 00000100:00100000:2.0:1789126758.578359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126758.580130:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276650880 00000100:00100000:0.0:1789126758.580212:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276650880 00000100:00100000:0.0:1789126758.580308:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789126758.580317:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2049128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276650880:12345-0@lo:41: 00000004:00000024:0.0:1789126758.580354:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789126758.580438:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2049128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276650880:12345-0@lo:41: Request processed in 114us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126758.580445:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789126758.580522:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027d29183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276650880:0@lo:41: 00010000:00010000:3.0:1789126758.827032:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126759.855326:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789126760.022339:0:7871:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789126760.022698:0:7871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789126760.874934:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789126761.461549:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7627fbd0 20000000:00000080:2.0:1789126761.461569:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9942360a6400 uarg=0000000000000000 20000000:01000000:2.0:1789126761.461611:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789126761.461618:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789126761.461623:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789126761.461726:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789126761.461741:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789126761.479639:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126761.479876:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789126761.479917:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789126761.479933:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789126761.479948:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789126761.479976:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.479994:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.480001:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea603 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.480007:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.480045:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.480057:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 17 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126761.480070:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df7c24c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876035276651008:0@lo:104: 00000100:00100000:0.0:1789126761.480132:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789126761.480205:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126761.480213:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126761.480234:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041bfc91c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876035276651136:0@lo:104: 00000100:00100000:0.0:1789126761.480252:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8ed3a09 going to sleep for 11 seconds 00000100:00100000:2.0:1789126761.480609:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789126761.480628:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126761.480671:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651008 00000100:00100000:2.0:1789126761.480677:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651008 00000100:00100000:2.0:1789126761.480707:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651136 00000100:00100000:2.0:1789126761.480709:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651136 00000100:00100000:2.0:1789126761.480720:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126761.480726:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e0cafe0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:7919:x1876035276651008:12345-0@lo:104: 00010000:00010000:2.0:1789126761.480737:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480788:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126761.480792:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e0cafe0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:7919:x1876035276651008:12345-0@lo:104: Request processed in 68us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126761.480799:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126761.480838:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789126761.480843:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000488c56db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:7919:x1876035276651136:12345-0@lo:104: 00010000:00010000:2.0:1789126761.480848:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480872:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126761.480875:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000488c56db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:7919:x1876035276651136:12345-0@lo:104: Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126761.480881:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789126761.480893:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789126761.480897:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480914:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2b6237c already unused, calling callback (000000002af92885) 10000000:00010000:2.0:1789126761.480917:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480924:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126761.480930:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126761.480935:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126761.480969:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480976:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126761.480992:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.480997:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000c2b6237c/0xa840b4da666ea603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea60a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481009:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126761.481011:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481016:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0c28d2c already unused, calling callback (000000002af92885) 10000000:00010000:2.0:1789126761.481018:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481033:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126761.481039:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126761.481044:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126761.481069:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481075:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126761.481079:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481085:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000f0c28d2c/0xa840b4da666ea515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea51c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126761.481101:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126761.481103:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126761.481105:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126761.481115:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096a24d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276651264:0@lo:103: 00000100:00100000:3.0:1789126761.481135:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df7c24c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876035276651008:0@lo:104: 00000100:00100000:2.0:1789126761.481147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126761.481159:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041bfc91c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876035276651136:0@lo:104: 00000100:00100000:2.0:1789126761.481189:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789126761.481190:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126761.481198:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000faadeacd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276651392:0@lo:103: 00000100:00100000:2.0:1789126761.481335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126761.481377:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651264 00000100:00100000:2.0:1789126761.481378:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651392 00000100:00100000:3.0:1789126761.481382:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651264 00000100:00100000:2.0:1789126761.481385:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651392 00010000:00010000:2.0:1789126761.481406:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 19 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126761.481407:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 19 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126761.481432:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789126761.481444:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7838f02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+19:3641:x1876035276651264:12345-0@lo:103: 00010000:00010000:3.0:1789126761.481454:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126761.481458:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 19 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126761.481467:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 19 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126761.481485:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006263be09/0xa840b4da666ea60a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea603 expref: 19 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126761.481497:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126761.481524:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789126761.481532:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7838f02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+18:3641:x1876035276651264:12345-0@lo:103: Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126761.481532:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789126761.481541:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126761.481556:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789126761.481565:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb64dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+17:3641:x1876035276651392:12345-0@lo:103: 00010000:00010000:2.0:1789126761.481574:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126761.481578:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481587:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481597:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b5faad6/0xa840b4da666ea51c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea515 expref: 17 pid: 6507 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481607:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481615:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481626:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481632:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481638:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481643:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481685:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c3ed348 already unused, calling callback (0000000064ef3424) 00010000:00010000:2.0:1789126761.481688:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481695:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481708:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481718:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126761.481745:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb64dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+16:3641:x1876035276651392:12345-0@lo:103: Request processed in 182us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126761.481752:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789126761.481772:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000faadeacd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276651392:0@lo:103: 00000100:00100000:3.0:1789126761.481783:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096a24d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276651264:0@lo:103: 00010000:00010000:2.0:1789126761.481797:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481805:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.481811:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c3ed348/0xa840b4da666ea69d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126761.899764:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126762.155258:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276651520:0@lo:41: 00000100:00100000:3.0:1789126762.155339:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e2c605 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276651776:0@lo:400: 00000100:00100000:1.0:1789126762.155344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126762.155387:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126762.155406:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126762.155408:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276652032:0@lo:400: 00000100:00100000:3.0:1789126762.155411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276651904:0@lo:400: 00000100:00100000:3.0:1789126762.155431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.155431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126762.155556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651520 00000100:00100000:2.0:1789126762.155561:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2dc8e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276651648:0@lo:400: 00000100:00100000:0.0:1789126762.155563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651520 00000100:00100000:2.0:1789126762.155600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126762.155606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651904 00000100:00100000:0.0:1789126762.155610:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651904 00000100:00100000:0.0:1789126762.155633:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126762.155636:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276652160:0@lo:400: 00000100:00100000:0.0:1789126762.155643:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a9267d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276651520:12345-0@lo:41: 00000100:00100000:2.0:1789126762.155683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1789126762.155701:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789126762.155728:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651776 00000100:00100000:2.0:1789126762.155733:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651776 00000100:00100000:0.0:1789126762.155748:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a9267d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276651520:12345-0@lo:41: Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.155756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126762.155765:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652032 00000100:00100000:2.0:1789126762.155769:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652032 00000100:00100000:0.0:1789126762.155773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652160 00000100:00100000:0.0:1789126762.155778:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652160 00000100:00100000:2.0:1789126762.155789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789126762.155800:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789126762.155801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f36794b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276651776:12345-0@lo:400: 00000100:00100000:0.0:1789126762.155810:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056870a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276651904:12345-0@lo:400: 00000100:00100000:2.0:1789126762.155846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f36794b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276651776:12345-0@lo:400: Request processed in 49us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.155852:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056870a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276651904:12345-0@lo:400: Request processed in 44us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126762.155857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789126762.155864:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789126762.155878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126762.155884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789126762.155888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e06120a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276652032:12345-0@lo:400: 00000100:00100000:0.0:1789126762.155894:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021388559 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276652160:12345-0@lo:400: 00000100:00100000:2.0:1789126762.155930:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e06120a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276652032:12345-0@lo:400: Request processed in 44us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126762.155938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126762.155941:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021388559 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276652160:12345-0@lo:400: Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.155949:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789126762.155986:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b7522d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276652160:0@lo:400: 00000100:00100000:0.0:1789126762.156032:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276651648 00000100:00100000:0.0:1789126762.156036:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276651648 00000100:00100000:0.0:1789126762.156248:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789126762.156255:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c656dcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:3640:x1876035276651648:12345-0@lo:400: 00000100:00100000:0.0:1789126762.156361:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c656dcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:3640:x1876035276651648:12345-0@lo:400: Request processed in 107us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.156368:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789126762.156404:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2dc8e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276651648:0@lo:400: 00010000:00080000:1.0:1789126762.156480:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000bda85b6 x1876035276652032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126762.156491:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bda85b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276652032:0@lo:400: 00000100:00100000:1.0:1789126762.156504:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a57d2cef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276651520:0@lo:41: 00000100:00100000:3.0:1789126762.157856:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf36ea4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276651904:0@lo:400: 00010000:00080000:3.0:1789126762.157870:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e2e2c605 x1876035276651776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126762.157878:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e2c605 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276651776:0@lo:400: 10000000:01000000:2.0:1789126762.222045:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126762.222052:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 1 10000000:01000000:2.0:1789126762.222057:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126762.222096:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea6a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.222107:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea6a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.222117:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea6a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126762.222137:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652288:0@lo:101: 00000100:00100000:2.0:1789126762.222210:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126762.222262:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:1.0:1789126762.222322:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652288 00000100:00100000:1.0:1789126762.222328:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652288 00000100:00100000:1.0:1789126762.222366:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789126762.222373:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1289fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276652288:12345-0@lo:101: 00010000:00010000:1.0:1789126762.222385:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126762.222397:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d042c7de/0xa840b4da666ea6ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea6a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.222418:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d042c7de/0xa840b4da666ea6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.222442:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d042c7de/0xa840b4da666ea6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.222452:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d042c7de, rc 0) 00000100:00100000:1.0:1789126762.222500:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1289fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652288:12345-0@lo:101: Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.222508:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789126762.222868:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652288:0@lo:101: 00010000:00010000:2.0:1789126762.222887:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea6a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.222894:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000075e90dda/0xa840b4da666ea6a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126762.222951:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652416:0@lo:501: 00000100:00100000:2.0:1789126762.222978:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126762.222997:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:0.0:1789126762.223062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652416 00000100:00100000:0.0:1789126762.223067:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652416 00000100:00100000:0.0:1789126762.223100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789126762.223105:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077fc6d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652416:12345-0@lo:501: 00000100:00100000:0.0:1789126762.223211:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077fc6d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652416:12345-0@lo:501: Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.223218:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789126762.223298:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652416:0@lo:501: 00000100:00100000:2.0:1789126762.223324:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652544:0@lo:503: 00000100:00100000:2.0:1789126762.223360:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126762.223380:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3284b8 going to sleep for 11 seconds 00000100:00100000:0.0:1789126762.223728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652544 00000100:00100000:0.0:1789126762.223732:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652544 00000100:00100000:0.0:1789126762.223761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789126762.223766:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006830690f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652544:12345-0@lo:503: 00000100:00100000:0.0:1789126762.223890:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006830690f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652544:12345-0@lo:503: Request processed in 123us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126762.223897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789126762.224124:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c23a115 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652544:0@lo:503: 00000100:00100000:1.0:1789126762.224501:0:7942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013fb6a79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7942:1876035276652672:0@lo:502: 00000100:00100000:1.0:1789126762.224539:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.224599:0:7942:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094d5f61b going to sleep for 11 seconds 00000100:00100000:2.0:1789126762.224632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652672 00000100:00100000:2.0:1789126762.224637:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652672 00000100:00100000:2.0:1789126762.225155:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789126762.225164:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39fc719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:7942:x1876035276652672:12345-0@lo:502: 00000100:00100000:2.0:1789126762.225308:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39fc719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:7942:x1876035276652672:12345-0@lo:502: Request processed in 145us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126762.225315:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789126762.225392:0:7942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013fb6a79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7942:1876035276652672:0@lo:502: 00000020:01000000:1.0:1789126762.225416:0:7942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126762.225424:0:7942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126762.225427:0:7942:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789126762.225434:0:7942:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99423d256000 00000020:00000080:1.0:1789126762.225437:0:7942:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126762.225473:0:7942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7942:1876035276652800:0@lo:502: 00000100:00100000:1.0:1789126762.225506:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.225573:0:7942:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b28780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126762.225607:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652800 00000100:00100000:2.0:1789126762.225611:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652800 00000100:00100000:2.0:1789126762.225675:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789126762.225683:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:7942:x1876035276652800:12345-0@lo:502: 00000100:00100000:2.0:1789126762.225744:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:7942:x1876035276652800:12345-0@lo:502: Request processed in 61us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126762.225756:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789126762.226061:0:7942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7942:1876035276652800:0@lo:502: 00000020:01000000:1.0:1789126762.226079:0:7942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126762.226083:0:7942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126762.226085:0:7942:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789126762.226089:0:7942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789126762.226318:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789126762.226337:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126762.226345:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.226356:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126762.226365:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126762.226368:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 1 10000000:01000000:2.0:1789126762.226370:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126762.226393:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.226401:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126762.226409:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126762.226421:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652928:0@lo:101: 00000100:00100000:2.0:1789126762.226449:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126762.226478:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423805e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789126762.226620:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276652928 00000100:00100000:1.0:1789126762.226625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276652928 00000100:00100000:1.0:1789126762.226675:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789126762.226688:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276652928:12345-0@lo:101: 00010000:00010000:1.0:1789126762.226697:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126762.226708:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea6b2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.226728:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.226738:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.226746:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589e00, rc 0) 00000100:00100000:1.0:1789126762.226776:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276652928:12345-0@lo:101: Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.226781:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789126762.226808:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276652928:0@lo:101: 00010000:00010000:1.0:1789126762.226819:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.226828:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126762.226869:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276653056:0@lo:501: 00000100:00100000:1.0:1789126762.226892:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.226904:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b28840 going to sleep for 11 seconds 00000100:00100000:1.0:1789126762.226913:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653056 00000100:00100000:1.0:1789126762.226916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653056 00000100:00100000:1.0:1789126762.226930:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789126762.226934:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276653056:12345-0@lo:501: 00000100:00100000:1.0:1789126762.228967:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276653056:12345-0@lo:501: Request processed in 2024us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.228980:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789126762.229551:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276653056:0@lo:501: 00000100:00100000:0.0:1789126762.229590:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276653184:0@lo:503: 00000100:00100000:0.0:1789126762.229627:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126762.229693:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126762.229777:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653184 00000100:00100000:1.0:1789126762.229784:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653184 00000100:00100000:1.0:1789126762.229824:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126762.229833:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276653184:12345-0@lo:503: 00000100:00100000:1.0:1789126762.229932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276653184:12345-0@lo:503: Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.229940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789126762.229969:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276653184:0@lo:503: 00000100:00100000:1.0:1789126762.230280:0:7944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7944:1876035276653312:0@lo:502: 00000100:00100000:1.0:1789126762.230319:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.230341:0:7944:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789126762.230363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653312 00000100:00100000:0.0:1789126762.230368:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653312 00000100:00100000:0.0:1789126762.230401:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789126762.230409:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:7944:x1876035276653312:12345-0@lo:502: 00000100:00100000:0.0:1789126762.230492:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:7944:x1876035276653312:12345-0@lo:502: Request processed in 84us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.230500:0:7944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7944:1876035276653312:0@lo:502: 00000100:00100000:0.0:1789126762.230500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:01000000:1.0:1789126762.230523:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126762.230532:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126762.230534:0:7944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789126762.230543:0:7944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994212236800 00000020:00000080:1.0:1789126762.230547:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126762.230568:0:7944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7944:1876035276653440:0@lo:502: 00000100:00100000:1.0:1789126762.230605:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126762.230625:0:7944:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789126762.230670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653440 00000100:00100000:0.0:1789126762.230674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653440 00000100:00100000:1.0:1789126762.230701:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789126762.230902:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:7944:x1876035276653440:12345-0@lo:502: 00000100:00100000:1.0:1789126762.231038:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:7944:x1876035276653440:12345-0@lo:502: Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126762.231056:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789126762.231104:0:7944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:7944:1876035276653440:0@lo:502: 00000020:01000000:0.0:1789126762.231123:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126762.231127:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126762.231129:0:7944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789126762.231133:0:7944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789126762.231265:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789126762.231290:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126762.231299:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126762.231310:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126762.923777:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126763.696137:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126763.696169:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276653568:0@lo:41: 00000100:00100000:1.0:1789126763.696240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126763.696544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653568 00000100:00100000:0.0:1789126763.696552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653568 00000100:00100000:0.0:1789126763.696605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789126763.696616:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276653568:12345-0@lo:41: 00000004:00000024:0.0:1789126763.696673:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789126763.696724:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276653568:12345-0@lo:41: Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126763.696731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789126763.697498:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276653568:0@lo:41: 00010000:00010000:3.0:1789126763.965110:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126764.970754:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126765.998188:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126767.018795:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126767.277818:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276653952:0@lo:400: 00000100:00100000:1.0:1789126767.277841:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276653824:0@lo:400: 00000100:00100000:2.0:1789126767.277929:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276653696:0@lo:400: 00000100:00100000:1.0:1789126767.280243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126767.280243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126767.280273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126767.280334:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276654336:0@lo:41: 00000100:00100000:2.0:1789126767.280335:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276654208:0@lo:400: 00000100:00100000:1.0:1789126767.280391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126767.280400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276654080:0@lo:400: 00000100:00100000:0.0:1789126767.280423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653952 00000100:00100000:0.0:1789126767.280432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653952 00000100:00100000:2.0:1789126767.280436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126767.280475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653824 00000100:00100000:2.0:1789126767.280480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653824 00000100:00100000:0.0:1789126767.280480:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654336 00000100:00100000:0.0:1789126767.280485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654336 00000100:00100000:0.0:1789126767.280506:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789126767.280513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276653952:12345-0@lo:400: 00000100:00100000:2.0:1789126767.280519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654080 00000100:00100000:2.0:1789126767.280524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654080 00000100:00100000:1.0:1789126767.280530:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789126767.280544:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276654336:12345-0@lo:41: 00000100:00100000:2.0:1789126767.280547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789126767.280559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276653824:12345-0@lo:400: 00000004:00000024:1.0:1789126767.280576:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789126767.280757:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276653952:12345-0@lo:400: Request processed in 242us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126767.280765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789126767.280780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276653824:12345-0@lo:400: Request processed in 221us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126767.280783:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276654336:12345-0@lo:41: Request processed in 241us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126767.280797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789126767.280798:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126767.280803:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276653952:0@lo:400: 00000100:00100000:2.0:1789126767.280827:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126767.280835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276654080:12345-0@lo:400: 00000100:00100000:2.0:1789126767.280872:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276654080:12345-0@lo:400: Request processed in 38us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126767.280879:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126767.280901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276653696 00000100:00100000:2.0:1789126767.280905:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276653696 00000100:00100000:2.0:1789126767.280936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789126767.280944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:3642:x1876035276653696:12345-0@lo:400: 00000100:00100000:2.0:1789126767.280976:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:3642:x1876035276653696:12345-0@lo:400: Request processed in 34us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126767.280982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789126767.281010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126767.281038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654208 00000100:00100000:1.0:1789126767.281042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654208 00000100:00100000:2.0:1789126767.281049:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276653696:0@lo:400: 00000100:00100000:1.0:1789126767.281064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789126767.281070:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276654208:12345-0@lo:400: 00010000:00080000:2.0:1789126767.281093:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99420a88c3c0 x1876035276654080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126767.281110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276654208:12345-0@lo:400: Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126767.281116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276654080:0@lo:400: 00000100:00100000:1.0:1789126767.281117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789126767.281167:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276654208:0@lo:400: 00000100:00100000:2.0:1789126767.281194:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276654336:0@lo:41: 00010000:00080000:2.0:1789126767.281204:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99420a88d680 x1876035276653824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126767.281214:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276653824:0@lo:400: 00010000:00010000:3.0:1789126768.042838:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126768.813396:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126768.819490:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276654464:0@lo:41: 00000100:00100000:2.0:1789126768.819563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126768.819760:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654464 00000100:00100000:3.0:1789126768.819768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654464 00000100:00100000:3.0:1789126768.820305:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789126768.820317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276654464:12345-0@lo:41: 00000004:00000024:3.0:1789126768.820354:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789126768.820420:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276654464:12345-0@lo:41: Request processed in 106us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126768.820428:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789126768.821948:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276654464:0@lo:41: 00010000:00010000:2.0:1789126769.069149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126770.091943:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789126770.493312:0:8421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789126770.493317:0:8421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789126770.493319:0:8421:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789126770.493581:0:8421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994220b43000 00000020:01000004:2.0:1789126770.493599:0:8421:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789126770.493611:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789126770.493634:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9942366bb490) 00000020:00000080:2.0:1789126770.493666:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789126770.529375:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789126770.529681:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789126770.549644:0:8421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789126770.550038:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789126770.550050:0:8421:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789126770.550061:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ea6c7 00000020:01000004:2.0:1789126770.550067:0:8421:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789126770.550089:0:8421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789126770.550092:0:8421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789126770.550104:0:8421:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789126770.550121:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789126770.550135:0:8421:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9942366bced8) 00000020:00000080:2.0:1789126770.550146:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789126770.552373:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789126770.552536:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789126770.552543:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789126770.553975:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789126770.553983:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789126770.554370:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789126770.554376:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789126770.557345:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789126770.557518:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789126770.557524:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789126770.558470:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789126770.558478:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789126770.578475:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789126770.578884:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789126770.578891:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789126770.580795:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789126770.580864:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789126770.582219:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789126770.582229:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789126770.585613:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789126770.586001:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789126770.586008:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789126770.586539:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789126770.586546:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789126770.633346:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789126770.633553:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789126770.633561:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789126770.636280:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789126770.636295:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789126770.638530:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789126770.638862:0:8421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789126770.638926:0:8421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789126770.660634:0:8421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789126770.660691:0:8421:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789126770.660696:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789126770.660698:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789126770.660700:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789126770.660701:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789126770.660703:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789126770.660704:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789126770.660706:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789126770.660708:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789126770.660709:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789126770.660711:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789126770.660712:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789126770.660716:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789126770.660719:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789126770.660720:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789126770.660721:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789126770.660722:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789126770.660723:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789126770.660724:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789126770.660725:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789126770.660731:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789126770.660732:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789126770.660733:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789126770.660734:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789126770.661366:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789126770.661388:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276654592:0@lo:253: 00000100:00100000:1.0:1789126770.661457:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.661559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654592 00000100:00100000:2.0:1789126770.661566:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654592 00000100:00100000:1.0:1789126770.661567:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.661622:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789126770.661633:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:8421:x1876035276654592:12345-0@lo:253: 20000000:01000000:2.0:1789126770.661694:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789126770.661698:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789126770.661703:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789126770.661706:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789126770.662185:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789126770.662730:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789126770.662746:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789126770.662764:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789126770.662773:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789126770.662787:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789126770.662801:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789126770.662971:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789126770.663070:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:2.0:1789126770.663073:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789126770.663089:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789126770.663095:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789126770.663179:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789126770.663189:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:2.0:1789126770.663207:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789126770.663214:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789126770.663325:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789126770.663348:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789126770.663414:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1789126770.663425:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:2.0:1789126770.663427:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789126770.663440:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1789126770.663446:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789126770.663458:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1789126770.663463:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:2.0:1789126770.663475:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1789126770.663481:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789126770.663494:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1789126770.663509:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789126770.664007:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789126770.664019:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1789126770.664021:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789126770.664035:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789126770.664041:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789126770.664054:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789126770.664059:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1789126770.664072:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789126770.664096:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789126770.664119:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789126770.664136:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789126770.664148:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789126770.664151:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789126770.664154:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789126770.664191:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789126770.664194:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789126770.668885:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789126770.669107:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789126770.669147:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789126770.669162:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789126770.669174:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789126770.669176:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126770.669769:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126770.669791:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126770.669805:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789126770.669975:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789126770.670068:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789126770.670084:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789126770.670094:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789126770.670096:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126770.670497:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126770.670522:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126770.670538:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789126770.670742:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789126770.670759:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789126770.670772:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789126770.670780:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789126770.670782:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126770.671202:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126770.671223:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126770.671239:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789126770.671406:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789126770.671497:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789126770.671526:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1789126770.671540:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789126770.671558:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671575:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea59a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671582:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea611 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671589:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea649 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671595:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea665 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671601:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671608:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671846:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.671860:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.671874:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654720:0@lo:104: 00000100:00100000:3.0:1789126770.671936:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126770.672026:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.672034:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 18 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.672043:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654848:0@lo:104: 00000100:00100000:3.0:1789126770.672065:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126770.672217:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.672225:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 18 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.672234:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654976:0@lo:104: 00000100:00100000:3.0:1789126770.672257:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.672319:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654720 00000100:00100000:0.0:1789126770.672326:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654720 00000100:00100000:0.0:1789126770.672359:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654848 00000100:00100000:0.0:1789126770.672362:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654848 00000100:00100000:0.0:1789126770.672377:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126770.672386:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276654720:12345-0@lo:104: 00010000:00010000:0.0:1789126770.672397:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672465:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126770.672471:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276654720:12345-0@lo:104: Request processed in 86us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.672478:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126770.672494:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126770.672501:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276654848:12345-0@lo:104: 00010000:00010000:0.0:1789126770.672526:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672560:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789126770.672565:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276654848:12345-0@lo:104: Request processed in 67us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.672574:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789126770.672590:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126770.672595:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672602:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166ac00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126770.672605:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672613:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126770.672620:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126770.672625:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126770.672675:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672682:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126770.672698:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672705:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea68f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea696 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672722:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126770.672725:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672730:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126770.672732:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672739:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126770.672744:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126770.672749:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126770.672762:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672767:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126770.672773:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672778:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea66c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.672786:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126770.672788:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126770.672790:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126770.672808:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276655104:0@lo:103: 00000100:00100000:0.0:1789126770.672841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.672861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126770.672866:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276655232:0@lo:103: 00000100:00100000:0.0:1789126770.672884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.672910:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655104 00000100:00100000:0.0:1789126770.672914:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655104 00010000:00010000:0.0:1789126770.672930:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.672949:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655232 00000100:00100000:0.0:1789126770.672952:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655232 00010000:00010000:0.0:1789126770.672962:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 20 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.672979:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126770.673161:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+20:3641:x1876035276655104:12345-0@lo:103: 00010000:00010000:0.0:1789126770.673172:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126770.673177:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.673187:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.673201:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126770.673228:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+20:3641:x1876035276655104:12345-0@lo:103: Request processed in 244us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.673235:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126770.673248:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126770.673254:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+19:3641:x1876035276655232:12345-0@lo:103: 00010000:00010000:0.0:1789126770.673268:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126770.673273:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 19 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.673281:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 19 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.673290:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126770.673312:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+19:3641:x1876035276655232:12345-0@lo:103: Request processed in 58us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.673318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126770.673354:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276655232:0@lo:103: 00000100:00100000:0.0:1789126770.673362:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276655104:0@lo:103: 00010000:00010000:1.0:1789126770.673446:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126770.673626:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.673637:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.673680:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276655360:0@lo:104: 00000100:00100000:3.0:1789126770.673704:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126770.673853:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.673862:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 18 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.673870:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276655488:0@lo:104: 00000100:00100000:3.0:1789126770.673891:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.673919:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276654976 00000100:00100000:2.0:1789126770.673923:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276654976 00000100:00100000:2.0:1789126770.673946:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655360 00000100:00100000:2.0:1789126770.673949:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655360 00000100:00100000:2.0:1789126770.673960:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126770.673966:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276654976:12345-0@lo:104: 00010000:00010000:2.0:1789126770.673975:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.674287:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126770.674293:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6505:x1876035276654976:12345-0@lo:104: Request processed in 327us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.674300:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126770.674315:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789126770.674321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276655360:12345-0@lo:104: 00010000:00010000:2.0:1789126770.674328:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.674356:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126770.674361:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276655360:12345-0@lo:104: Request processed in 42us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.674366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789126770.674437:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789126770.674443:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674449:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126770.674454:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674463:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126770.674477:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126770.674483:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126770.674515:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674522:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126770.674538:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674545:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea650 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674559:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126770.674562:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674567:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126770.674570:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674576:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126770.674582:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126770.674587:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126770.674606:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674612:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126770.674618:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674624:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea618 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.674639:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.674640:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.674642:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126770.674667:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276655616:0@lo:103: 00000100:00100000:1.0:1789126770.674696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.674718:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126770.674724:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276655744:0@lo:103: 00000100:00100000:1.0:1789126770.674744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789126770.674766:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126770.674931:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655616 00000100:00100000:0.0:1789126770.674936:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655616 00010000:00010000:0.0:1789126770.674954:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.674980:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655744 00000100:00100000:0.0:1789126770.674991:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655744 00010000:00010000:0.0:1789126770.675003:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.675015:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789126770.675021:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+20:3639:x1876035276655616:12345-0@lo:103: 00010000:00010000:0.0:1789126770.675031:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126770.675035:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 20 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.675054:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 20 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.675068:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126770.675094:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+20:3639:x1876035276655616:12345-0@lo:103: Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.675100:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789126770.675125:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789126770.675132:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+19:3639:x1876035276655744:12345-0@lo:103: 00010000:00010000:0.0:1789126770.675139:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126770.675143:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.675152:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.675161:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126770.675181:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+19:3639:x1876035276655744:12345-0@lo:103: Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.675187:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789126770.675339:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276655744:0@lo:103: 00000100:00100000:2.0:1789126770.675347:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276655616:0@lo:103: 00000100:00100000:3.0:1789126770.675514:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea300 going to sleep for 11 seconds 00010000:00010000:3.0:1789126770.675531:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99424216c800/0xa840b4da666ea696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea68f expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.675542:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654720:0@lo:104: 00010000:00010000:3.0:1789126770.675552:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166a000/0xa840b4da666ea66c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea665 expref: 17 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.675560:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654848:0@lo:104: 00010000:00010000:3.0:1789126770.675570:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ee00/0xa840b4da666ea650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea649 expref: 16 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.675578:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276654976:0@lo:104: 00010000:00010000:3.0:1789126770.675586:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166b800/0xa840b4da666ea618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea611 expref: 15 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.675593:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276655360:0@lo:104: 00000100:00100000:2.0:1789126770.675635:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655488 00000100:00100000:2.0:1789126770.675640:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655488 00000100:00100000:2.0:1789126770.675865:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789126770.675872:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276655488:12345-0@lo:104: 00010000:00010000:2.0:1789126770.675882:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.675938:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126770.675943:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6505:x1876035276655488:12345-0@lo:104: Request processed in 73us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.675959:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789126770.676001:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126770.676006:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676013:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126770.676017:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676034:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126770.676040:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126770.676044:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126770.676068:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676073:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126770.676087:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676092:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99424216d000/0xa840b4da666ea59a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea5a1 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676105:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126770.676107:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126770.676120:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126770.676128:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126770.676138:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276655872:0@lo:103: 00000100:00100000:0.0:1789126770.676171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.676197:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276655872 00000100:00100000:0.0:1789126770.676201:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276655872 00010000:00010000:0.0:1789126770.676217:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 15 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.676235:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789126770.676241:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+15:3642:x1876035276655872:12345-0@lo:103: 00010000:00010000:0.0:1789126770.676255:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126770.676260:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 15 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676269:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 15 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676283:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676291:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676305:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676312:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676318:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676324:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676329:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148fa00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126770.676333:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676339:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676359:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.676368:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126770.676397:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+15:3642:x1876035276655872:12345-0@lo:103: Request processed in 156us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.676404:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789126770.676590:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276655872:0@lo:103: 00010000:00010000:3.0:1789126770.676683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99424216dc00/0xa840b4da666ea5a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea59a expref: 14 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.676692:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876035276655488:0@lo:104: 00010000:00010000:3.0:1789126770.676717:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.676725:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.676731:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.676737:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148fa00/0xa840b4da666ea6d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789126770.676749:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789126770.679248:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+13:8421:x1876035276654592:12345-0@lo:253: Request processed in 17610us (17784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.679261:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789126770.679382:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276654592:0@lo:253: 10000000:01000000:1.0:1789126770.679397:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789126770.679400:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789126770.679401:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789126770.679403:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789126770.679404:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789126770.679405:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789126770.679406:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789126770.679408:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789126770.679409:0:8421:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789126770.679410:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789126770.679411:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789126770.679444:0:8421:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994220b43000 from lustre-OST0000 10000000:01000000:1.0:1789126770.679479:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789126770.679482:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789126770.679491:0:8421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f0000 local copy 10000000:01000000:1.0:1789126770.679494:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789126770.679525:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.679534:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.679543:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126770.679558:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656000:0@lo:101: 00000100:00100000:1.0:1789126770.679588:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.679623:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.679767:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656000 00000100:00100000:2.0:1789126770.679773:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656000 00000100:00100000:2.0:1789126770.679806:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789126770.679813:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+13:8421:x1876035276656000:12345-0@lo:101: 00010000:00010000:2.0:1789126770.679825:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126770.679837:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166be00/0xa840b4da666ea6e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea6dc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.679856:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166be00/0xa840b4da666ea6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea6dc expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.679866:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166be00/0xa840b4da666ea6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6dc expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.679874:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166be00, rc 0) 00000100:00100000:2.0:1789126770.679916:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656000:12345-0@lo:101: Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.679922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789126770.679987:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656000:0@lo:101: 00010000:00010000:3.0:1789126770.680000:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.680008:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.680085:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656128:0@lo:501: 00000100:00100000:3.0:1789126770.680123:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.680158:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.680272:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656128 00000100:00100000:1.0:1789126770.680276:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656128 00000100:00100000:1.0:1789126770.680309:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789126770.680316:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656128:12345-0@lo:501: 00000100:00100000:1.0:1789126770.680377:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656128:12345-0@lo:501: Request processed in 62us (266us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126770.680384:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789126770.680514:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656128:0@lo:501: 10000000:01000000:0.0:1789126770.680529:0:8421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789126770.680548:0:8421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789126770.680553:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.680560:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.680566:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.680585:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789126770.680607:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994220b43000 10000000:01000000:0.0:1789126770.680612:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789126770.680617:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789126770.680620:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789126770.680624:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789126770.680626:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789126770.680682:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.680689:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.680695:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.680707:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656256:0@lo:101: 00000100:00100000:0.0:1789126770.680736:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.680753:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789126770.680892:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656256 00000100:00100000:3.0:1789126770.680897:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656256 00000100:00100000:3.0:1789126770.680931:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789126770.680938:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656256:12345-0@lo:101: 00010000:00010000:3.0:1789126770.680946:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126770.680954:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea6ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.680969:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.680977:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.680985:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ee00, rc 0) 00000100:00100000:3.0:1789126770.681013:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276656256:12345-0@lo:101: Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.681019:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789126770.681086:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656256:0@lo:101: 00010000:00010000:0.0:1789126770.681097:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.681105:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.681174:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656384:0@lo:501: 00000100:00100000:0.0:1789126770.681198:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.681225:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00010000:00010000:1.0:1789126770.681319:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126770.681325:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681332:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126770.681336:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681354:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126770.681362:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126770.681368:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126770.681385:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681392:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126770.681414:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681494:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588000/0xa840b4da666ea6dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea6e3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681505:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.681507:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.681508:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126770.681518:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126770.681529:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276656512:0@lo:103: 00000100:00100000:1.0:1789126770.681556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.681582:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656512 00000100:00100000:1.0:1789126770.681586:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656512 00000100:00100000:1.0:1789126770.681618:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789126770.681625:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+15:3641:x1876035276656512:12345-0@lo:103: 00010000:00010000:1.0:1789126770.681634:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126770.681645:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166be00/0xa840b4da666ea6e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea6dc expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.681680:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126770.681709:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+14:3641:x1876035276656512:12345-0@lo:103: Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.681715:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789126770.681742:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276656512:0@lo:103: 00000100:00100000:2.0:1789126770.681801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656384 00000100:00100000:2.0:1789126770.681806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656384 00000100:00100000:2.0:1789126770.681837:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789126770.681844:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656384:12345-0@lo:501: 00000100:00100000:2.0:1789126770.681937:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656384:12345-0@lo:501: Request processed in 94us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.681944:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789126770.682240:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656384:0@lo:501: 00000100:00100000:0.0:1789126770.682270:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656640:0@lo:503: 00000100:00100000:0.0:1789126770.682311:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.682339:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.682386:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656640 00000100:00100000:2.0:1789126770.682390:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656640 00000100:00100000:2.0:1789126770.682434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789126770.682441:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656640:12345-0@lo:503: 00000100:00100000:2.0:1789126770.682518:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656640:12345-0@lo:503: Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.682525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789126770.682680:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656640:0@lo:503: 00000040:00080000:0.0:1789126770.682900:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789126770.682977:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656768:0@lo:502: 00000100:00100000:0.0:1789126770.683027:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.683043:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789126770.683177:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656768 00000100:00100000:3.0:1789126770.683182:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656768 00000100:00100000:3.0:1789126770.683205:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789126770.683211:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656768:12345-0@lo:502: 00000100:00100000:3.0:1789126770.683292:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656768:12345-0@lo:502: Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.683299:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789126770.683437:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656768:0@lo:502: 00000040:00080000:0.0:1789126770.683602:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789126770.683627:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789126770.683641:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789126770.683685:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789126770.683700:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789126770.683713:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789126770.683734:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656896:0@lo:502: 00000100:00100000:0.0:1789126770.683771:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.683795:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789126770.683906:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276656896 00000100:00100000:3.0:1789126770.683910:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276656896 00000100:00100000:3.0:1789126770.683929:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789126770.683934:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656896:12345-0@lo:502: 00000100:00100000:3.0:1789126770.684021:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276656896:12345-0@lo:502: Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.684028:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789126770.684266:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276656896:0@lo:502: 00000040:00080000:0.0:1789126770.684304:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789126770.684311:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789126770.685898:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789126770.685909:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789126770.685916:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126770.685918:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789126770.685924:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789126770.685938:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99422d563490) 00000020:00000080:0.0:1789126770.685960:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789126770.685966:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789126770.686105:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994220b43000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789126770.686126:0:8444:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789126770.686133:0:8444:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ea6ff 00010000:00010000:0.0:1789126770.694403:0:8444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789126770.695121:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789126770.702084:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789126770.702452:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789126770.709283:0:8444:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789126770.709527:0:8444:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789126770.718131:0:8444:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789126770.719920:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789126770.719931:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126770.719936:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126770.719939:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789126770.719942:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126770.719945:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126770.719947:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789126770.719950:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789126770.719951:0:8444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789126770.720079:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126770.720084:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126770.720086:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789126770.720089:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789126770.720499:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789126770.720529:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789126770.720563:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.720581:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126770.720589:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 1 10000000:01000000:2.0:1789126770.720592:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126770.720627:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.720635:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.720669:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126770.720703:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657024:0@lo:101: 00000100:00100000:2.0:1789126770.720773:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.720977:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942061530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126770.721360:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657024 00000100:00100000:3.0:1789126770.721367:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657024 00000100:00100000:3.0:1789126770.721409:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789126770.721418:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:8421:x1876035276657024:12345-0@lo:101: 00010000:00010000:3.0:1789126770.721430:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126770.721443:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea706 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.721466:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea706 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.721477:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea706 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.721486:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126770.721542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657024:12345-0@lo:101: Request processed in 124us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.721549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789126770.722070:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657024:0@lo:101: 00010000:00010000:2.0:1789126770.722087:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126770.722105:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126770.722225:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657152:0@lo:501: 00000100:00100000:2.0:1789126770.722327:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.722362:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942061530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126770.722417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657152 00000100:00100000:3.0:1789126770.722423:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657152 00000100:00100000:3.0:1789126770.722456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789126770.722465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657152:12345-0@lo:501: 00000100:00100000:3.0:1789126770.722864:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657152:12345-0@lo:501: Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126770.722873:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789126770.723051:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657152:0@lo:501: 00000100:00100000:2.0:1789126770.723081:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657280:0@lo:503: 00000100:00100000:2.0:1789126770.723137:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.723202:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942061530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.723416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657280 00000100:00100000:1.0:1789126770.723421:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657280 00000100:00100000:1.0:1789126770.723482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789126770.723491:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657280:12345-0@lo:503: 00000100:00100000:1.0:1789126770.723640:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657280:12345-0@lo:503: Request processed in 150us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.723672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789126770.728167:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657280:0@lo:503: 00000040:00080000:2.0:1789126770.728511:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789126770.728896:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657408:0@lo:502: 00000100:00100000:2.0:1789126770.728964:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.729122:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942061530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.729204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657408 00000100:00100000:1.0:1789126770.729211:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657408 00000100:00100000:1.0:1789126770.729261:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789126770.729271:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657408:12345-0@lo:502: 00000100:00100000:1.0:1789126770.729372:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657408:12345-0@lo:502: Request processed in 103us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.729381:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789126770.729538:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657408:0@lo:502: 00000040:00080000:2.0:1789126770.730317:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789126770.730348:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789126770.730376:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657536:0@lo:502: 00000100:00100000:2.0:1789126770.730424:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126770.730452:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942061530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.731823:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657536 00000100:00100000:1.0:1789126770.731834:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657536 00000100:00100000:1.0:1789126770.731892:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789126770.731901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657536:12345-0@lo:502: 00000100:00100000:1.0:1789126770.732042:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657536:12345-0@lo:502: Request processed in 142us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.732059:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789126770.732681:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657536:0@lo:502: 00000040:00080000:2.0:1789126770.732753:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789126770.732763:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789126770.734452:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126770.734463:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126770.734466:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789126770.734472:0:8448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994220b43000 00000020:00000080:0.0:1789126770.734475:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789126770.734486:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126770.734489:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126770.734490:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789126770.734493:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789126770.734601:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789126770.734627:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126770.734704:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.734717:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126770.734767:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789126770.734770:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994220b43000 10000000:01000000:3.0:1789126770.734774:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994220b43000 10000000:01000000:3.0:1789126770.734778:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789126770.734784:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994220b43000 from 1 10000000:01000000:3.0:1789126770.734787:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789126770.734819:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.734827:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.734848:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.734870:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657664:0@lo:101: 00000100:00100000:3.0:1789126770.734930:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.734970:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942052ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.735067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657664 00000100:00100000:1.0:1789126770.735075:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657664 00000100:00100000:1.0:1789126770.735157:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789126770.735166:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8421:x1876035276657664:12345-0@lo:101: 00010000:00010000:1.0:1789126770.735178:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126770.735191:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea714 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.735214:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea714 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.735225:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea714 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.735243:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588000, rc 0) 00000100:00100000:1.0:1789126770.735290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276657664:12345-0@lo:101: Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.735296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789126770.735364:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657664:0@lo:101: 00010000:00010000:3.0:1789126770.735378:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.735387:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.735452:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657792:0@lo:501: 00000100:00100000:3.0:1789126770.735471:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.735591:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942052ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.735879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657792 00000100:00100000:2.0:1789126770.735884:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657792 00000100:00100000:2.0:1789126770.735903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789126770.735909:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276657792:12345-0@lo:501: 00000100:00100000:2.0:1789126770.736102:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276657792:12345-0@lo:501: Request processed in 192us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.736117:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126770.736320:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657792:0@lo:501: 00000100:00100000:3.0:1789126770.736351:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657920:0@lo:503: 00000100:00100000:3.0:1789126770.736405:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.736462:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942052ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.736493:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276657920 00000100:00100000:2.0:1789126770.736497:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276657920 00000100:00100000:0.0:1789126770.736789:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789126770.736800:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276657920:12345-0@lo:503: 00000100:00100000:0.0:1789126770.736889:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276657920:12345-0@lo:503: Request processed in 92us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.736897:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789126770.736905:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276657920:0@lo:503: 00000040:00080000:3.0:1789126770.737154:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789126770.737215:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276658048:0@lo:502: 00000100:00100000:3.0:1789126770.737264:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.737666:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b180 going to sleep for 11 seconds 00000100:00100000:0.0:1789126770.740355:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658048 00000100:00100000:0.0:1789126770.740368:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658048 00000100:00100000:1.0:1789126770.740419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789126770.740431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276658048:12345-0@lo:502: 00000100:00100000:1.0:1789126770.741117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276658048:12345-0@lo:502: Request processed in 679us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.741126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126770.741214:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276658048:0@lo:502: 00000040:00080000:3.0:1789126770.741488:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789126770.741510:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789126770.741517:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789126770.741524:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789126770.741530:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789126770.741537:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789126770.741546:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789126770.741627:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789126770.741960:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789126770.742038:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789126770.742052:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789126770.742062:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789126770.742071:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789126770.742081:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789126770.742090:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789126770.742124:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789126770.742137:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789126770.742147:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789126770.742157:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789126770.742166:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789126770.742175:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789126770.742184:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789126770.742193:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789126770.742203:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789126770.742213:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789126770.742222:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789126770.742297:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789126770.742317:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789126770.742330:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789126770.742342:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789126770.742354:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789126770.742388:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789126770.742402:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789126770.742415:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789126770.742429:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789126770.742440:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789126770.742451:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789126770.742483:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276658176:0@lo:502: 00000100:00100000:3.0:1789126770.742535:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.742639:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b180 going to sleep for 11 seconds 00000100:00100000:0.0:1789126770.742917:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658176 00000100:00100000:0.0:1789126770.742922:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658176 00000100:00100000:0.0:1789126770.742957:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789126770.743036:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276658176:12345-0@lo:502: 00000100:00100000:0.0:1789126770.743197:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276658176:12345-0@lo:502: Request processed in 231us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.743204:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126770.743325:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276658176:0@lo:502: 00000040:00080000:3.0:1789126770.743372:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789126770.743380:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789126770.744165:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789126770.744181:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99422d564ed8) 00000020:00000080:0.0:1789126770.744206:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789126770.744353:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994220b43000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789126770.744357:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994220b43000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789126770.744359:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994220b43000 3 00010000:00080000:0.0:1789126770.744386:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102d0a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126770.748166:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789126770.748440:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789126770.748501:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789126770.748520:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa840b4da666ea729 00000100:00080000:1.0:1789126770.748531:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126770.748537:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994102d0a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126770.748643:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423675d680 x1876035276658304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126770.748925:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276658304:0@lo:38: 00000100:00100000:0.0:1789126770.749000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789126770.749108:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789126770.749194:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276658432:0@lo:400: 00000100:00100000:1.0:1789126770.749222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.749309:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126770.749317:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276658560:0@lo:400: 00000100:00100000:1.0:1789126770.749343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.749373:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276658688:0@lo:400: 00000100:00100000:1.0:1789126770.749394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.749409:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126770.749414:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276658816:0@lo:400: 00000100:00100000:1.0:1789126770.749433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.749460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658304 00000100:00100000:1.0:1789126770.749466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658304 00000100:00100000:1.0:1789126770.749485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658432 00000100:00100000:1.0:1789126770.749488:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658432 00000100:00100000:1.0:1789126770.749506:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658688 00000100:00100000:1.0:1789126770.749509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658688 00000100:00100000:1.0:1789126770.749522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789126770.749529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276658432:12345-0@lo:400: 00000100:00100000:1.0:1789126770.751170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276658432:12345-0@lo:400: Request processed in 1635us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.751183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789126770.751214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789126770.751861:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99423675d2c0 x1876035276658432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126770.751876:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276658432:0@lo:400: 00000100:00100000:1.0:1789126770.752034:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276658688:12345-0@lo:400: 00000100:00100000:1.0:1789126770.752107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276658688:12345-0@lo:400: Request processed in 880us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.752123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789126770.752144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789126770.752149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276658304:12345-0@lo:38: 00010000:00080000:1.0:1789126770.752171:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1789126770.752203:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa840b4da666ea730 00000004:00100000:1.0:1789126770.752218:0:6513:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:3.0:1789126770.752683:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99423675f480 x1876035276658688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126770.752871:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276658688:0@lo:400: 00000100:00080000:1.0:1789126770.752965:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9942290bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126770.753516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876035276658304:12345-0@lo:38: Request processed in 1364us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.753526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789126770.753569:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658560 00000100:00100000:1.0:1789126770.753575:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658560 00000100:00100000:1.0:1789126770.753614:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658816 00000100:00100000:1.0:1789126770.753618:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658816 00000100:00100000:1.0:1789126770.753633:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789126770.753639:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276658560:12345-0@lo:400: 00000100:00100000:1.0:1789126770.753894:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276658560:12345-0@lo:400: Request processed in 254us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.753901:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789126770.753915:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789126770.753921:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276658816:12345-0@lo:400: 00000100:00100000:1.0:1789126770.753956:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276658816:12345-0@lo:400: Request processed in 35us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.753962:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789126770.754008:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276658816:0@lo:400: 00000100:00100000:1.0:1789126770.754035:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276658560:0@lo:400: 00000020:01000004:1.0:1789126770.754251:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789126770.754277:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff994102eb8000) 00000020:00000080:1.0:1789126770.754297:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789126770.754380:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994220b43000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789126770.754385:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994220b43000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789126770.754388:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994220b43000 3 00010000:00080000:1.0:1789126770.754414:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994236581800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126770.757155:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789126770.758171:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789126770.758215:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789126770.758226:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa840b4da666ea73e 00010000:00080000:0.0:1789126770.758343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99423675d680 x1876035276658304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126770.758356:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789126770.758367:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789126770.758375:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789126770.758379:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789126770.758383:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789126770.758391:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276658304:0@lo:38: 00000100:00080000:1.0:1789126770.758455:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126770.758461:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff994236581800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126770.758489:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423675da40 x1876035276658944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126770.758538:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276658944:0@lo:38: 00000100:00080000:1.0:1789126770.758631:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789126770.758923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126770.758988:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276658944 00000100:00100000:0.0:1789126770.758994:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276658944 00000100:00100000:0.0:1789126770.759025:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126770.759031:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276658944:12345-0@lo:38: 00010000:00080000:0.0:1789126770.759053:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1789126770.759098:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa840b4da666ea745 00000004:00100000:0.0:1789126770.759123:0:6513:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789126770.759153:0:6513:0:(import.c:65:import_set_state_nolock()) ffff994102d0f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789126770.759199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876035276658944:12345-0@lo:38: Request processed in 167us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126770.759214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789126770.759260:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99423675da40 x1876035276658944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126770.759268:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789126770.759273:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789126770.759278:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789126770.759281:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789126770.759283:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994236581800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789126770.759288:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276658944:0@lo:38: 00000040:00080000:0.0:1789126770.760025:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789126770.760356:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789126770.760387:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126770.760530:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126770.760542:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789126770.760598:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789126770.760604:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789126770.760605:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126770.760606:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126770.760607:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126770.760609:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126770.760610:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789126770.760611:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126770.760612:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126770.760614:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126770.760615:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789126770.760619:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789126770.760621:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789126770.760622:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789126770.760623:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126770.760625:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126770.760626:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126770.760627:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126770.760627:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789126770.760628:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126770.760629:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126770.760630:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126770.760631:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789126770.760827:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789126770.760843:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276659072:0@lo:253: 00000100:00100000:3.0:1789126770.760899:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126770.760932:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789126770.761405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659072 00000100:00100000:2.0:1789126770.761412:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659072 00000100:00100000:2.0:1789126770.761456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789126770.761465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276659072:12345-0@lo:253: 20000000:01000000:2.0:1789126770.761489:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789126770.761503:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789126770.767977:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789126770.768024:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789126770.768423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:8421:x1876035276659072:12345-0@lo:253: Request processed in 6955us (7519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126770.768435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 20000000:01000000:0.0:1789126770.768507:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789126770.768512:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789126770.768532:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768547:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea63b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768555:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea657 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768570:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768606:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768620:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 15 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.768897:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276659200:0@lo:104: 00000100:00100000:0.0:1789126770.768941:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789126770.768987:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.768995:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 15 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.769002:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276659328:0@lo:104: 00000100:00100000:0.0:1789126770.769021:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45240 going to sleep for 11 seconds 00000100:00100000:1.0:1789126770.769074:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789126770.769092:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.769128:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659200 00000100:00100000:1.0:1789126770.769134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659200 00000100:00100000:1.0:1789126770.769164:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659328 00000100:00100000:1.0:1789126770.769166:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659328 00000100:00100000:1.0:1789126770.769180:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126770.769188:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942360a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276659200:12345-0@lo:104: 00010000:00010000:1.0:1789126770.769200:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769277:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789126770.769282:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942360a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276659200:12345-0@lo:104: Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.769289:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126770.769323:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789126770.769330:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276659328:12345-0@lo:104: 00010000:00010000:1.0:1789126770.769337:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769371:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789126770.769375:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276659328:12345-0@lo:104: Request processed in 47us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.769381:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789126770.769397:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789126770.769403:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769410:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126770.769413:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769421:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126770.769429:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126770.769435:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126770.769468:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769475:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126770.769490:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769496:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148f800/0xa840b4da666ea657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea65e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769507:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126770.769509:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769514:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126770.769517:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769522:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126770.769528:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126770.769532:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126770.769543:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769549:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126770.769553:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769831:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148ec00/0xa840b4da666ea63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea642 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.769845:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.769847:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.769848:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126770.769855:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126770.769867:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659456:0@lo:103: 00000100:00100000:1.0:1789126770.769896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.769924:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126770.769930:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659584:0@lo:103: 00000100:00100000:1.0:1789126770.769949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126770.769978:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659456 00000100:00100000:1.0:1789126770.769982:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659456 00010000:00010000:1.0:1789126770.769998:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 16 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126770.770017:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659584 00000100:00100000:1.0:1789126770.770020:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659584 00010000:00010000:1.0:1789126770.770029:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 17 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126770.770045:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126770.770051:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3639:x1876035276659456:12345-0@lo:103: 00010000:00010000:1.0:1789126770.770060:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126770.770065:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 17 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770085:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 17 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770100:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126770.770139:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3639:x1876035276659456:12345-0@lo:103: Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.770145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126770.770160:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789126770.770166:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+16:3639:x1876035276659584:12345-0@lo:103: 00010000:00010000:1.0:1789126770.770173:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126770.770178:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 16 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770186:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 16 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770197:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770204:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789126770.770216:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002708759s 00010000:00010000:1.0:1789126770.770220:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770227:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.770345:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030400/0xa840b4da666ea65e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea657 expref: 16 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.770357:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276659200:0@lo:104: 00010000:00010000:0.0:1789126770.770367:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ea00/0xa840b4da666ea642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea63b expref: 15 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126770.770375:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276659328:0@lo:104: 00010000:00010000:1.0:1789126770.770417:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.770432:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126770.770489:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:8421:1876035276659072:0@lo:253: 10000000:01000000:3.0:1789126770.770500:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789126770.770503:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789126770.770505:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789126770.770506:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789126770.770507:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789126770.770508:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789126770.770509:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789126770.770511:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789126770.770513:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789126770.770514:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789126770.770516:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789126770.770523:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789126770.770534:0:8421:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789126770.774618:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.774641:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126770.774660:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789126770.776514:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789126770.776959:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789126770.777201:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:1.0:1789126770.777330:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126770.777338:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.777351:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.777366:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.777376:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030000/0xa840b4da666ea74c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126770.777396:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126770.777467:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+14:3639:x1876035276659584:12345-0@lo:103: Request processed in 7297us (7512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126770.777477:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789126770.777533:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659584:0@lo:103: 00000100:00100000:1.0:1789126770.777543:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659456:0@lo:103: 00080000:10000000:3.0:1789126770.778018:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789126770.778391:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789126770.778537:0:8421:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789126770.783163:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789126770.792865:0:8421:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789126770.792873:0:8421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789126770.792902:0:8421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789126770.792945:0:8421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789126770.792962:0:8421:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789126770.792982:0:8421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789126770.795939:0:8421:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126770.796152:0:8421:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789126771.117511:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789126771.534502:0:8504:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126771.534895:0:8504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789126772.140516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126772.394944:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276659712:0@lo:41: 00000100:00100000:1.0:1789126772.395016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126772.395133:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659712 00000100:00100000:3.0:1789126772.395141:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659712 00000100:00100000:3.0:1789126772.395195:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789126772.395205:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276659712:12345-0@lo:41: 00000004:00000024:3.0:1789126772.395238:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789126772.395282:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276659712:12345-0@lo:41: Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126772.395289:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789126772.395415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276659712:0@lo:41: 00010000:00010000:1.0:1789126773.162839:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126773.930867:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276659840:0@lo:41: 00000100:00100000:2.0:1789126773.930949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126773.931062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659840 00000100:00100000:1.0:1789126773.931070:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659840 00000100:00100000:1.0:1789126773.931129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789126773.931138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276659840:12345-0@lo:41: 00000004:00000024:1.0:1789126773.931168:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789126773.931215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276659840:12345-0@lo:41: Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126773.931223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789126773.931467:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276659840:0@lo:41: 00010000:00010000:2.0:1789126774.188769:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126775.211508:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789126775.866384:0:8793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789126775.985980:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276660096:0@lo:400: 00000100:00100000:3.0:1789126775.985985:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276660224:0@lo:400: 00000100:00100000:1.0:1789126775.986064:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659968:0@lo:400: 00000100:00100000:3.0:1789126775.990476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126775.990544:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276660736:0@lo:400: 00000100:00100000:3.0:1789126775.990592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126775.990637:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126775.990645:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276660352:0@lo:400: 00000100:00100000:3.0:1789126775.990687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126775.990736:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660224 00000100:00100000:3.0:1789126775.990743:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660224 00000100:00100000:3.0:1789126775.990786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789126775.990797:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276660224:12345-0@lo:400: 00000100:00100000:3.0:1789126775.990849:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276660224:12345-0@lo:400: Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.990856:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789126775.990883:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660736 00000100:00100000:3.0:1789126775.990886:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660736 00000100:00100000:3.0:1789126775.990922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660352 00000100:00100000:3.0:1789126775.990925:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660352 00000100:00100000:3.0:1789126775.990937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789126775.990943:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276660736:12345-0@lo:400: 00000100:00100000:3.0:1789126775.990974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276660736:12345-0@lo:400: Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.990980:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789126775.990992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789126775.990997:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276660352:12345-0@lo:400: 00000100:00100000:3.0:1789126775.991022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276660352:12345-0@lo:400: Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.991028:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789126775.991115:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ec5e00 x1876035276660352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126775.991129:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276660352:0@lo:400: 00000100:00100000:3.0:1789126775.991152:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276660224:0@lo:400: 00010000:00080000:3.0:1789126775.991161:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423647f480 x1876035276660736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126775.991168:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276660736:0@lo:400: 00000100:00080000:2.0:1789126775.991452:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126775.993583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126775.993707:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276660608:0@lo:400: 00000100:00100000:0.0:1789126775.993748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126775.994609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660096 00000100:00100000:3.0:1789126775.994619:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660096 00000100:00100000:3.0:1789126775.994689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660608 00000100:00100000:3.0:1789126775.994693:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660608 00000100:00100000:3.0:1789126775.994723:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789126775.994733:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276660096:12345-0@lo:400: 00000100:00100000:3.0:1789126775.994804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276660096:12345-0@lo:400: Request processed in 73us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.994811:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789126775.994829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789126775.994836:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276660608:12345-0@lo:400: 00000100:00100000:3.0:1789126775.994863:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276660608:12345-0@lo:400: Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.994869:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789126775.994885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126775.995007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126775.995047:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276660480:0@lo:400: 00000100:00100000:1.0:1789126775.995084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126775.995166:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276659968 00000100:00100000:3.0:1789126775.995171:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276659968 00000100:00100000:3.0:1789126775.995213:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789126775.995221:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:3639:x1876035276659968:12345-0@lo:400: 00000100:00100000:3.0:1789126775.995257:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:3639:x1876035276659968:12345-0@lo:400: Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126775.995264:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789126775.995417:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276659968:0@lo:400: 00000100:00100000:2.0:1789126775.995475:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660480 00000100:00100000:2.0:1789126775.995484:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660480 00000100:00100000:2.0:1789126775.995522:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126775.995530:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276660480:12345-0@lo:400: 00000100:00100000:2.0:1789126775.995580:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276660480:12345-0@lo:400: Request processed in 51us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126775.995587:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789126775.995733:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ec7480 x1876035276660096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126775.995745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276660096:0@lo:400: 00010000:00080000:0.0:1789126775.995755:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423647c000 x1876035276660608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126775.995764:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276660608:0@lo:400: 00000100:00100000:1.0:1789126775.995876:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276660480:0@lo:400: 00010000:00010000:2.0:1789126776.235014:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789126776.600275:0:8846:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126776.600585:0:8846:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126777.264946:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126777.516366:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126777.516414:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276660864:0@lo:41: 00000100:00100000:1.0:1789126777.516501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126777.516723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660864 00000100:00100000:3.0:1789126777.516731:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660864 00000100:00100000:3.0:1789126777.516781:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789126777.516789:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276660864:12345-0@lo:41: 00000004:00000024:3.0:1789126777.516832:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789126777.518587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276660864:12345-0@lo:41: Request processed in 1791us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126777.518599:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789126777.520923:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276660864:0@lo:41: 10000000:01000000:2.0:1789126778.027797:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789126778.027804:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99423d256000 from 30 10000000:01000000:2.0:1789126778.027809:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789126778.028221:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.028233:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.028243:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.028281:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276660992:0@lo:101: 00000100:00100000:2.0:1789126778.028399:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.028567:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126778.028987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276660992 00000100:00100000:1.0:1789126778.028995:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276660992 00000100:00100000:1.0:1789126778.029045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789126778.029054:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+14:6509:x1876035276660992:12345-0@lo:101: 00010000:00010000:1.0:1789126778.029076:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126778.029091:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea753 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.029150:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea753 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.029161:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea753 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.029170:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588e00, rc 0) 00000100:00100000:1.0:1789126778.029235:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276660992:12345-0@lo:101: Request processed in 182us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.029241:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789126778.031716:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276660992:0@lo:101: 00010000:00010000:2.0:1789126778.031741:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.031754:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.031843:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661120:0@lo:501: 00000100:00100000:2.0:1789126778.031910:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.032001:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661120 00000100:00100000:1.0:1789126778.032007:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661120 00000100:00100000:1.0:1789126778.032100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789126778.032110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276661120:12345-0@lo:501: 00000100:00100000:1.0:1789126778.032251:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276661120:12345-0@lo:501: Request processed in 142us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.032258:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789126778.035603:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.035660:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661120:0@lo:501: 00000100:00100000:2.0:1789126778.035717:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661248:0@lo:503: 00000100:00100000:2.0:1789126778.035806:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.036035:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.037463:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661248 00000100:00100000:3.0:1789126778.037474:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661248 00000100:00100000:3.0:1789126778.037602:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789126778.037612:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276661248:12345-0@lo:503: 00000100:00100000:3.0:1789126778.037819:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276661248:12345-0@lo:503: Request processed in 207us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.039337:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789126778.039498:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661248:0@lo:503: 00000100:00100000:1.0:1789126778.046249:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8898:1876035276661376:0@lo:502: 00000100:00100000:1.0:1789126778.046334:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.046383:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.046526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661376 00000100:00100000:0.0:1789126778.046533:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661376 00000100:00100000:0.0:1789126778.046584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789126778.046593:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8898:x1876035276661376:12345-0@lo:502: 00000100:00100000:0.0:1789126778.046912:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:8898:x1876035276661376:12345-0@lo:502: Request processed in 138us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.046922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789126778.047170:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8898:1876035276661376:0@lo:502: 00000100:00100000:2.0:1789126778.047222:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8898:1876035276661504:0@lo:502: 00000100:00100000:2.0:1789126778.047261:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.047281:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.047309:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661504 00000100:00100000:3.0:1789126778.047412:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661504 00000100:00100000:3.0:1789126778.047495:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789126778.047505:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:8898:x1876035276661504:12345-0@lo:502: 00000100:00100000:3.0:1789126778.047599:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:8898:x1876035276661504:12345-0@lo:502: Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.047607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789126778.047683:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8898:1876035276661504:0@lo:502: 00000040:00080000:2.0:1789126778.047704:0:8898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789126778.048206:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789126778.048229:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789126778.048239:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.048250:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126778.048272:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789126778.048274:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99423d256000 from 5 10000000:01000000:1.0:1789126778.048277:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789126778.048305:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.048313:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.048322:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126778.048334:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661632:0@lo:101: 00000100:00100000:1.0:1789126778.048364:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.048397:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.048687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661632 00000100:00100000:0.0:1789126778.048692:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661632 00000100:00100000:0.0:1789126778.048725:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789126778.048732:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276661632:12345-0@lo:101: 00010000:00010000:0.0:1789126778.048742:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126778.048760:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea761 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.048779:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea761 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.048789:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea761 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.048798:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030000, rc 0) 00000100:00100000:0.0:1789126778.048832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276661632:12345-0@lo:101: Request processed in 100us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.048838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789126778.048941:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661632:0@lo:101: 00010000:00010000:2.0:1789126778.048953:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.048962:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.049004:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661760:0@lo:256: 00000100:00100000:2.0:1789126778.049030:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.049350:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.049375:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661760 00000100:00100000:3.0:1789126778.049379:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661760 00000100:00100000:3.0:1789126778.049405:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789126778.049412:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276661760:12345-0@lo:256: 20000000:01000000:3.0:1789126778.049424:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789126778.049439:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789126778.049445:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789126778.049638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276661760:12345-0@lo:256: Request processed in 226us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.049645:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789126778.049756:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661760:0@lo:256: 10000000:01000000:2.0:1789126778.049801:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789126778.049807:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.049816:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126778.049824:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789126778.049827:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789126778.049829:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789126778.049846:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.049853:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.049861:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.049871:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661888:0@lo:101: 00000100:00100000:2.0:1789126778.049908:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.049932:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126778.049973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276661888 00000100:00100000:1.0:1789126778.049977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276661888 00000100:00100000:1.0:1789126778.050037:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789126778.050043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276661888:12345-0@lo:101: 00010000:00010000:1.0:1789126778.050051:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126778.050070:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea76f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.050087:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea76f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.050096:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea76f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.050114:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588200, rc 0) 00000100:00100000:1.0:1789126778.050154:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276661888:12345-0@lo:101: Request processed in 111us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.050160:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789126778.050207:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276661888:0@lo:101: 00010000:00010000:2.0:1789126778.050217:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.050225:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.050277:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276662016:0@lo:501: 00000100:00100000:2.0:1789126778.050298:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.050415:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.050478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662016 00000100:00100000:0.0:1789126778.050482:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662016 00000100:00100000:0.0:1789126778.050500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789126778.050505:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276662016:12345-0@lo:501: 00000100:00100000:0.0:1789126778.050613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276662016:12345-0@lo:501: Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.050620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789126778.050705:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276662016:0@lo:501: 00000100:00100000:2.0:1789126778.050728:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276662144:0@lo:503: 00000100:00100000:2.0:1789126778.050764:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.050792:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.050837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662144 00000100:00100000:0.0:1789126778.050841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662144 00000100:00100000:0.0:1789126778.050859:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126778.050865:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276662144:12345-0@lo:503: 00000100:00100000:0.0:1789126778.050970:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276662144:12345-0@lo:503: Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.050976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789126778.051047:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276662144:0@lo:503: 00000100:00100000:2.0:1789126778.051565:0:8899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8899:1876035276662272:0@lo:502: 00000100:00100000:2.0:1789126778.051605:0:8899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.051630:0:8899:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.051870:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662272 00000100:00100000:0.0:1789126778.051875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662272 00000100:00100000:0.0:1789126778.051904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789126778.051910:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:8899:x1876035276662272:12345-0@lo:502: 00000100:00100000:0.0:1789126778.052003:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:8899:x1876035276662272:12345-0@lo:502: Request processed in 92us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.052010:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789126778.052096:0:8899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8899:1876035276662272:0@lo:502: 00000020:01000000:2.0:1789126778.052118:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789126778.052125:0:8899:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789126778.052131:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126778.052133:0:8899:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789126778.052150:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789126778.052154:0:8899:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1789126778.052176:0:8899:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789126778.052178:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789126778.052191:0:8899:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9942366b8000) 00000020:00000080:2.0:1789126778.052211:0:8899:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789126778.052217:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789126778.052294:0:8899:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789126778.052300:0:8899:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789126778.052313:0:8899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea784 00010000:00080000:2.0:1789126778.052340:0:8899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102d1a000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789126778.052582:0:8899:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789126778.063492:0:8899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789126778.063520:0:8899:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789126778.063816:0:8899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126778.064319:0:8899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126778.064436:0:8899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789126778.064525:0:8899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789126778.064994:0:8900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126778.064998:0:8900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789126778.065895:0:8899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126778.065908:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789126778.065947:0:8899:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789126778.065970:0:8899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea78b 00000100:00080000:0.0:1789126778.065981:0:8899:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789126778.065987:0:8899:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff994102d1a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126778.066283:0:8899:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ee12c0 x1876035276662400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126778.066346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276662400:0@lo:8: 00000100:00100000:2.0:1789126778.066442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789126778.066506:0:8899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789126778.066579:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126778.066583:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126778.066585:0:8899:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789126778.066588:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126778.066593:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126778.066594:0:8899:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789126778.066597:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789126778.066599:0:8899:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789126778.066630:0:8899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8899:1876035276662656:0@lo:502: 00000100:00100000:0.0:1789126778.066703:0:8899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126778.066741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662656 00000100:00100000:0.0:1789126778.066748:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662656 00000100:00100000:3.0:1789126778.066763:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276662528:0@lo:400: 00000100:00100000:0.0:1789126778.066790:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789126778.066799:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:8899:x1876035276662656:12345-0@lo:502: 00000100:00100000:1.0:1789126778.066929:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662400 00000100:00100000:1.0:1789126778.066934:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662400 00000100:00100000:1.0:1789126778.066956:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789126778.066961:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276662400:12345-0@lo:8: 00010000:00080000:1.0:1789126778.066983:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1789126778.067010:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea792 00000100:00100000:0.0:1789126778.067323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:8899:x1876035276662656:12345-0@lo:502: Request processed in 523us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.067332:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789126778.067377:0:8899:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230ba3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.067397:0:8899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8899:1876035276662656:0@lo:502: 00000020:01000000:0.0:1789126778.067424:0:8899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126778.067429:0:8899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126778.067430:0:8899:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789126778.067434:0:8899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00002000:00100000:1.0:1789126778.067691:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9942364bd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789126778.067697:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789126778.067701:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789126778.067779:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789126778.067864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.067893:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276663168:0@lo:400: 00002000:00080000:1.0:1789126778.068070:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789126778.068097:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9942364be000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126778.068150:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276662400:12345-0@lo:8: Request processed in 1185us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.068158:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126778.068162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.068192:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789126778.068200:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276662784:0@lo:400: 00000100:00100000:3.0:1789126778.068230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.068249:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276663296:0@lo:400: 00000100:00100000:3.0:1789126778.068283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.068318:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276662912:0@lo:400: 00010000:00080000:1.0:1789126778.068331:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee12c0 x1876035276662400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789126788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126778.068343:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789126778.068352:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00100000:3.0:1789126778.068357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789126778.068362:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789126778.068369:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:3.0:1789126778.068376:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789126778.068380:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d1a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789126778.068385:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276663040:0@lo:400: 00000004:00080000:1.0:1789126778.068398:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789126778.068406:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276662400:0@lo:8: 00000100:00100000:3.0:1789126778.068415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.068453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662528 00000100:00100000:3.0:1789126778.068459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662528 00000100:00100000:1.0:1789126778.068462:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276663424:0@lo:700: 00000100:00100000:3.0:1789126778.068494:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663168 00000100:00100000:3.0:1789126778.068500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663168 00000100:00100000:1.0:1789126778.068500:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.068522:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.068530:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663296 00000100:00100000:3.0:1789126778.068535:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663296 00000100:00100000:3.0:1789126778.068552:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662912 00000100:00100000:3.0:1789126778.068555:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662912 00000100:00100000:3.0:1789126778.068569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789126778.068576:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276662528:12345-0@lo:400: 00000100:00100000:3.0:1789126778.068640:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276662528:12345-0@lo:400: Request processed in 61us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.068667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789126778.068686:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789126778.068693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789126778.068698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276663168:12345-0@lo:400: 00000100:00100000:3.0:1789126778.068705:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276663296:12345-0@lo:400: 00000100:00100000:0.0:1789126778.068749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276663168:12345-0@lo:400: Request processed in 56us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.068757:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276663296:12345-0@lo:400: Request processed in 55us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.068758:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789126778.068769:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789126778.068781:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789126778.068789:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276662912:12345-0@lo:400: 00000100:00100000:3.0:1789126778.068796:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276662784 00000100:00100000:3.0:1789126778.068801:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276662784 00000100:00100000:0.0:1789126778.068825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276662912:12345-0@lo:400: Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.068829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663040 00000100:00100000:0.0:1789126778.068834:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789126778.068835:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663040 00000100:00100000:3.0:1789126778.068855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789126778.068864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276662784:12345-0@lo:400: 00000100:00100000:3.0:1789126778.068917:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276662784:12345-0@lo:400: Request processed in 55us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.068924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789126778.068941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789126778.068949:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276663040:12345-0@lo:400: 00000100:00100000:1.0:1789126778.068960:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276662784:0@lo:400: 00010000:00080000:1.0:1789126778.068981:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ec7480 x1876035276663296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126778.068992:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276663040:12345-0@lo:400: Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.068993:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276663296:0@lo:400: 00000100:00100000:3.0:1789126778.069007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789126778.069015:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420aa821c0 x1876035276662528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126778.069039:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663424 00000100:00100000:3.0:1789126778.069043:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663424 00000100:00100000:3.0:1789126778.069102:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126778.069110:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8901:x1876035276663424:12345-0@lo:700: 00000100:00100000:3.0:1789126778.069138:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876035276663552:0@lo:700: 00000100:00100000:3.0:1789126778.069171:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.069187:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29af00 going to sleep for 11 seconds 00000100:00080000:3.0:1789126778.069199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126778.069203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126778.069205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126778.069225:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276663040:0@lo:400: 00010000:00080000:3.0:1789126778.069235:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423647c000 x1876035276662912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126778.069244:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276662912:0@lo:400: 00000004:00080000:3.0:1789126778.069283:0:8900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789126778.069313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663552 00000100:00100000:0.0:1789126778.069319:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663552 00000100:00100000:0.0:1789126778.069349:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1789126778.069351:0:8900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 203273701621ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789126778.069360:0:8900:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789126778.069360:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876035276663552:12345-0@lo:700: 00000100:00100000:1.0:1789126778.069486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276662528:0@lo:400: 00010000:00080000:1.0:1789126778.069508:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ec4000 x1876035276663168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126778.069517:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276663168:0@lo:400: 00000020:01000000:2.0:1789126778.069609:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789126778.069636:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789126778.071082:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789126778.071097:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:2.0:1789126778.071101:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126778.071280:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789126778.071283:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994212236800 from 30 10000000:01000000:2.0:1789126778.071287:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789126778.071322:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.071331:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.071340:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.071359:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663680:0@lo:101: 00000100:00100000:2.0:1789126778.071418:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.071467:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.071547:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663680 00000100:00100000:3.0:1789126778.071553:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663680 00000100:00100000:3.0:1789126778.071637:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789126778.071673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276663680:12345-0@lo:101: 00010000:00010000:3.0:1789126778.071687:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126778.071701:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea799 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.071724:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea799 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.071735:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea799 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.071744:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126778.071796:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276663680:12345-0@lo:101: Request processed in 150us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.071803:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789126778.071887:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663680:0@lo:101: 00010000:00010000:2.0:1789126778.071901:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.071909:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.071988:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663808:0@lo:501: 00000100:00100000:2.0:1789126778.072033:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.072385:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.072506:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663808 00000100:00100000:0.0:1789126778.072512:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663808 00000100:00100000:0.0:1789126778.072539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789126778.072546:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276663808:12345-0@lo:501: 00000100:00100000:0.0:1789126778.072698:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276663808:12345-0@lo:501: Request processed in 152us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.072705:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789126778.072813:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663808:0@lo:501: 00000100:00100000:2.0:1789126778.072851:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663936:0@lo:503: 00000100:00100000:2.0:1789126778.072893:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.072913:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.072925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276663936 00000100:00100000:2.0:1789126778.072928:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276663936 00000100:00100000:2.0:1789126778.072947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789126778.072953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276663936:12345-0@lo:503: 00000100:00100000:2.0:1789126778.073034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276663936:12345-0@lo:503: Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.073040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789126778.073089:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276663936:0@lo:503: 00000100:00100000:2.0:1789126778.073284:0:8902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8902:1876035276664064:0@lo:502: 00000100:00100000:2.0:1789126778.073315:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.073332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664064 00000100:00100000:2.0:1789126778.073336:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664064 00000100:00100000:2.0:1789126778.073360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789126778.073366:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:8902:x1876035276664064:12345-0@lo:502: 00000100:00100000:2.0:1789126778.073433:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:8902:x1876035276664064:12345-0@lo:502: Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.073438:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789126778.073464:0:8902:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.073476:0:8902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8902:1876035276664064:0@lo:502: 00000100:00100000:2.0:1789126778.073513:0:8902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8902:1876035276664192:0@lo:502: 00000100:00100000:2.0:1789126778.073544:0:8902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.073562:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664192 00000100:00100000:2.0:1789126778.073565:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664192 00000100:00100000:2.0:1789126778.073583:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789126778.073587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:8902:x1876035276664192:12345-0@lo:502: 00000100:00100000:2.0:1789126778.073641:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:8902:x1876035276664192:12345-0@lo:502: Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.073676:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789126778.073782:0:8902:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.073795:0:8902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8902:1876035276664192:0@lo:502: 00000040:00080000:2.0:1789126778.073813:0:8902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789126778.073859:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789126778.073876:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789126778.073884:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.073907:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126778.073924:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789126778.073927:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994212236800 from 5 10000000:01000000:2.0:1789126778.073929:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789126778.073950:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.073956:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.073964:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.073975:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664320:0@lo:101: 00000100:00100000:2.0:1789126778.074000:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.074014:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.074025:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664320 00000100:00100000:2.0:1789126778.074028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664320 00000100:00100000:2.0:1789126778.074045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789126778.074050:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276664320:12345-0@lo:101: 00010000:00010000:2.0:1789126778.074067:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126778.074094:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea7a7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074113:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074122:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074142:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166be00, rc 0) 00000100:00100000:2.0:1789126778.074171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276664320:12345-0@lo:101: Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.074177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789126778.074205:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664320:0@lo:101: 00010000:00010000:2.0:1789126778.074216:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074224:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.074260:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664448:0@lo:256: 00000100:00100000:2.0:1789126778.074288:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.074301:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.074311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664448 00000100:00100000:2.0:1789126778.074314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664448 00000100:00100000:2.0:1789126778.074332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789126778.074337:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276664448:12345-0@lo:256: 20000000:01000000:2.0:1789126778.074349:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789126778.074362:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789126778.074365:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789126778.074436:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276664448:12345-0@lo:256: Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.074442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789126778.074468:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664448:0@lo:256: 10000000:01000000:2.0:1789126778.074505:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789126778.074515:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074522:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126778.074529:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789126778.074531:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789126778.074533:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789126778.074555:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074563:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074571:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.074582:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664576:0@lo:101: 00000100:00100000:2.0:1789126778.074606:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.074619:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.074630:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664576 00000100:00100000:2.0:1789126778.074633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664576 00000100:00100000:2.0:1789126778.074672:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789126778.074678:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276664576:12345-0@lo:101: 00010000:00010000:2.0:1789126778.074685:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126778.074693:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea7b5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074707:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074723:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074730:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3c00, rc 0) 00000100:00100000:2.0:1789126778.074759:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276664576:12345-0@lo:101: Request processed in 81us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.074764:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789126778.074793:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664576:0@lo:101: 00010000:00010000:2.0:1789126778.074803:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126778.074810:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126778.074851:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664704:0@lo:501: 00000100:00100000:2.0:1789126778.074875:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.074889:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126778.074899:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664704 00000100:00100000:2.0:1789126778.074902:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664704 00000100:00100000:2.0:1789126778.074917:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789126778.074922:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276664704:12345-0@lo:501: 00000100:00100000:2.0:1789126778.075012:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276664704:12345-0@lo:501: Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.075017:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789126778.075042:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664704:0@lo:501: 00000100:00100000:2.0:1789126778.075078:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664832:0@lo:503: 00000100:00100000:2.0:1789126778.075119:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.075134:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.075159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664832 00000100:00100000:3.0:1789126778.075165:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664832 00000100:00100000:3.0:1789126778.075196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789126778.075205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276664832:12345-0@lo:503: 00000100:00100000:3.0:1789126778.075311:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276664832:12345-0@lo:503: Request processed in 107us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.075318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789126778.076547:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276664832:0@lo:503: 40000000:02000000:3.0:1789126778.077024:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789126778.081860:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8903:1876035276664960:0@lo:502: 00000100:00100000:2.0:1789126778.081947:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.082032:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.082330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876035276663552:12345-0@lo:700: Request processed in 12972us (13156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.082345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789126778.082475:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f99e580 x1876035276663552/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.082488:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876035276663552:0@lo:700: 40000000:02000000:2.0:1789126778.082498:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1789126778.084692:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276664960 00000100:00100000:0.0:1789126778.084702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276664960 00000100:00100000:0.0:1789126778.084794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789126778.084803:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:8903:x1876035276664960:12345-0@lo:502: 00000100:00100000:0.0:1789126778.084960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:8903:x1876035276664960:12345-0@lo:502: Request processed in 158us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.084968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789126778.085050:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8903:1876035276664960:0@lo:502: 00000020:01000000:1.0:1789126778.087208:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789126778.087219:0:8903:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789126778.087228:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126778.087231:0:8903:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789126778.087237:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789126778.087242:0:8903:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:1.0:1789126778.087267:0:8903:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789126778.087270:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789126778.087296:0:8903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff994102eb9a48) 00000020:00000080:1.0:1789126778.087321:0:8903:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789126778.087327:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789126778.087429:0:8903:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789126778.087436:0:8903:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789126778.087442:0:8903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea7ca 00010000:00080000:1.0:1789126778.087472:0:8903:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422f9ea000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126778.088331:0:8903:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1789126778.090963:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789126778.091145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276663424:12345-0@lo:700: Request processed in 22030us (22640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.091168:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789126778.091278:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423675f840 x1876035276663424/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.091293:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276663424:0@lo:700: 00000040:01000000:1.0:1789126778.092845:0:8903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789126778.092866:0:8903:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789126778.093537:0:8903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789126778.093929:0:8903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789126778.094033:0:8903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789126778.097567:0:8903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789126778.098570:0:8904:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126778.098576:0:8904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789126778.102082:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126778.102106:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276665088:0@lo:13: 00000100:00100000:2.0:1789126778.102358:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789126778.102414:0:8901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789126778.102438:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276665216:0@lo:7: 00000100:00100000:2.0:1789126778.102465:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.102560:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665088 00000100:00100000:3.0:1789126778.102567:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665088 00000100:00100000:3.0:1789126778.102621:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126778.102632:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276665088:12345-0@lo:13: 00002000:00000024:3.0:1789126778.102678:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789126778.102731:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276665088:12345-0@lo:13: Request processed in 101us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.102738:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1789126778.103482:0:8903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789126778.103496:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789126778.103549:0:8903:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789126778.103573:0:8903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea7d1 00000100:00080000:3.0:1789126778.103582:0:8903:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789126778.103587:0:8903:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99422f9ea000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789126778.103614:0:8903:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422f99c780 x1876035276665344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789126778.103645:0:8903:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789126778.103731:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126778.103735:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126778.103737:0:8903:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789126778.103740:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126778.103744:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126778.103746:0:8903:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789126778.103749:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789126778.103751:0:8903:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789126778.103773:0:8903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8903:1876035276665472:0@lo:502: 00000100:00100000:3.0:1789126778.103980:0:8903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.104023:0:8903:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.104085:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665472 00000100:00100000:0.0:1789126778.104091:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665472 00000100:00100000:0.0:1789126778.104136:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789126778.104145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:8903:x1876035276665472:12345-0@lo:502: 00000100:00100000:0.0:1789126778.104291:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:8903:x1876035276665472:12345-0@lo:502: Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.104299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789126778.104516:0:8903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:8903:1876035276665472:0@lo:502: 00000020:01000000:3.0:1789126778.104542:0:8903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126778.104548:0:8903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126778.104549:0:8903:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789126778.104552:0:8903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789126778.104733:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276665344:0@lo:8: 00000020:01000000:0.0:1789126778.104877:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789126778.104896:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789126778.104904:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.104926:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126778.104936:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789126778.104938:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f0000 from 1 10000000:01000000:0.0:1789126778.104941:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789126778.104967:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.104974:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126778.104983:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126778.104995:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276665600:0@lo:101: 00000100:00100000:0.0:1789126778.105022:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126778.105052:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45240 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.105107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665600 00000100:00100000:3.0:1789126778.105112:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665600 00000100:00100000:3.0:1789126778.105146:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789126778.105154:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276665600:12345-0@lo:101: 00010000:00010000:3.0:1789126778.105165:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126778.105178:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea7d8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.105336:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.105347:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126778.105356:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ec00, rc 0) 00000100:00100000:3.0:1789126778.105402:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276665600:12345-0@lo:101: Request processed in 249us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.105408:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789126778.105483:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276665600:0@lo:101: 00010000:00010000:1.0:1789126778.105496:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.105505:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126778.105570:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276665728:0@lo:501: 00000100:00100000:1.0:1789126778.105598:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.105618:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126778.105699:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665728 00000100:00100000:3.0:1789126778.105703:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665728 00000100:00100000:3.0:1789126778.105728:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789126778.105734:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276665728:12345-0@lo:501: 00000100:00100000:3.0:1789126778.106164:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276665728:12345-0@lo:501: Request processed in 427us (563us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789126778.106172:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1789126778.106562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664c3c0 x1876035276665088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.106581:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276665088:0@lo:13: 00000100:00100000:2.0:1789126778.106603:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.106766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.106932:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665216 00000100:00100000:2.0:1789126778.106947:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665216 00000100:00100000:2.0:1789126778.106988:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665344 00000100:00100000:2.0:1789126778.106991:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665344 00000100:00100000:2.0:1789126778.107004:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126778.107012:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276665216:12345-0@lo:7: 00000100:00100000:1.0:1789126778.112328:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276665728:0@lo:501: 10000000:01000000:1.0:1789126778.112399:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789126778.112415:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126778.112426:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789126778.114366:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789126778.114374:0:8428:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789126778.114547:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276665216:12345-0@lo:7: Request processed in 7533us (12078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.114560:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126778.114590:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126778.114597:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276665344:12345-0@lo:8: 00010000:00080000:2.0:1789126778.114627:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1789126778.114690:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea7e6 00002000:00100000:2.0:1789126778.114705:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99422f9c3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789126778.114710:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789126778.114713:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789126778.114753:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789126778.114778:0:8428:0:(import.c:65:import_set_state_nolock()) ffff99422f9c4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126778.114845:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276665344:12345-0@lo:8: Request processed in 247us (8079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.114852:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789126778.114963:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f99c780 x1876035276665344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789126788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126778.114975:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789126778.114983:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789126778.114991:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789126778.114996:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789126778.114998:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422f9ea000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789126778.115024:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789126778.115029:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276665344:0@lo:8: 00000004:00080000:2.0:1789126778.117218:0:8905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789126778.117250:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276665984:0@lo:7: 00000100:00100000:2.0:1789126778.117314:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.117340:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.117436:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276665856:0@lo:13: 00000100:00100000:0.0:1789126778.117465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.117587:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665984 00000100:00100000:3.0:1789126778.117594:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665984 00000100:00100000:3.0:1789126778.117645:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789126778.117674:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8905:x1876035276665984:12345-0@lo:7: 00000100:00100000:2.0:1789126778.118762:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276665856 00000100:00100000:2.0:1789126778.118773:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276665856 00000100:00100000:2.0:1789126778.118821:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126778.118830:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276665856:12345-0@lo:13: 00002000:00000024:2.0:1789126778.118846:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789126778.118907:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276665856:12345-0@lo:13: Request processed in 78us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126778.118914:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789126778.118997:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664c3c0 x1876035276665856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126778.119017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276665856:0@lo:13: 00010000:00080000:1.0:1789126778.119745:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664de00 x1876035276665216/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126778.119758:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276665216:0@lo:7: 00000004:00080000:1.0:1789126778.119769:0:8901:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000004:00080000:1.0:1789126778.121737:0:8904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789126778.121824:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203326174642ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789126778.121831:0:8904:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789126778.123231:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:2.0:1789126778.124005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126778.125977:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276666112:0@lo:5: 00002000:00080000:3.0:1789126778.126470:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789126778.126477:0:8429:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789126778.126526:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.126551:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8905:x1876035276665984:12345-0@lo:7: Request processed in 8876us (9235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126778.126562:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789126778.126578:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45240 going to sleep for 11 seconds 00010000:00080000:2.0:1789126778.126733:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f0c0 x1876035276665984/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.126747:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276665984:0@lo:7: 00000004:00080000:2.0:1789126778.126758:0:8905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789126778.126783:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666240:0@lo:5: 00000100:00100000:2.0:1789126778.126821:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.126835:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126778.126952:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666112 00000100:00100000:1.0:1789126778.126958:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666112 00000100:00100000:1.0:1789126778.126992:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666240 00000100:00100000:1.0:1789126778.126996:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666240 00000100:00100000:1.0:1789126778.127014:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789126778.127023:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276666112:12345-0@lo:5: 00002000:00080000:1.0:1789126778.127047:0:8428:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789126778.127103:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276666112:12345-0@lo:5: Request processed in 82us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.127109:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789126778.127126:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789126778.127132:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8905:x1876035276666240:12345-0@lo:5: 00002000:00080000:1.0:1789126778.127142:0:8428:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789126778.127145:0:8428:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1789126778.127454:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee3840 x1876035276666112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.127465:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276666112:0@lo:5: 00000004:00080000:2.0:1789126778.127474:0:8901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789126778.127504:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276666368:0@lo:5: 00000100:00100000:2.0:1789126778.127539:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126778.127567:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126778.127905:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789126778.127920:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789126778.128128:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666368 00000100:00100000:2.0:1789126778.128132:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666368 00000100:00100000:1.0:1789126778.128252:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789126778.128261:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8901:x1876035276666368:12345-0@lo:5: 00002000:00080000:1.0:1789126778.128285:0:8906:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:3.0:1789126778.133409:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789126778.133432:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789126778.134444:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8905:x1876035276666240:12345-0@lo:5: Request processed in 7306us (7616us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789126778.134457:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789126778.134563:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f0c0 x1876035276666240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.134580:0:8905:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789126778.134587:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666240:0@lo:5: 00000004:00080000:2.0:1789126778.134602:0:8905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789126778.134763:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666496:0@lo:700: 00000100:00100000:2.0:1789126778.134796:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126778.134812:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8901:x1876035276666368:12345-0@lo:5: Request processed in 6552us (7273us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789126778.134823:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789126778.134844:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664c780 x1876035276666368/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126778.134857:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8901:1876035276666368:0@lo:5: 00000004:00080000:3.0:1789126778.134866:0:8901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789126778.134897:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8901:1876035276666624:0@lo:900: 00000100:00100000:3.0:1789126778.134991:0:8901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126778.135029:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789126778.135362:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666496 00000100:00100000:1.0:1789126778.135370:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666496 00000100:00100000:1.0:1789126778.135412:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789126778.135421:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1876035276666496:12345-0@lo:700: 00000100:00100000:2.0:1789126778.135542:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126778.135733:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666624 00000100:00100000:0.0:1789126778.135737:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666624 00000100:00100000:0.0:1789126778.135764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789126778.135770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8901:x1876035276666624:12345-0@lo:900: 00000100:00100000:0.0:1789126778.135866:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8901:x1876035276666624:12345-0@lo:900: Request processed in 94us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126778.135873:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789126778.136109:0:8901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f99fc00 x1876035276666624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.136120:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8901:1876035276666624:0@lo:900: 00000001:00080000:3.0:1789126778.138790:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1789126778.138994:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1876035276666496:12345-0@lo:700: Request processed in 3570us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126778.139007:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789126778.139336:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f0c0 x1876035276666496/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.139351:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666496:0@lo:700: 00000004:02000040:2.0:1789126778.143428:0:8905:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789126778.147950:0:8905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666752:0@lo:5: 00000100:00100000:2.0:1789126778.148022:0:8905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126778.148195:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666752 00000100:00100000:1.0:1789126778.148203:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666752 00000100:00100000:1.0:1789126778.148246:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789126778.148255:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8905:x1876035276666752:12345-0@lo:5: 00000100:00100000:2.0:1789126778.148683:0:8905:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1789126778.152898:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789126778.152919:0:8429:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789126778.154720:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8905:x1876035276666752:12345-0@lo:5: Request processed in 6460us (6692us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789126778.154733:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789126778.154866:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f0c0 x1876035276666752/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126778.154885:0:8905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1876035276666752:0@lo:5: 00000004:00080000:2.0:1789126778.154900:0:8905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789126778.282751:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789126778.295389:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:1.0:1789126778.995961:0:8956:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789126778.996228:0:8956:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789126779.053635:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276666880:0@lo:41: 00000100:00100000:3.0:1789126779.053734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126779.053948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276666880 00000100:00100000:1.0:1789126779.053955:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276666880 00000100:00100000:1.0:1789126779.053996:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789126779.054006:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276666880:12345-0@lo:41: 00000004:00000024:1.0:1789126779.054046:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789126779.054121:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276666880:12345-0@lo:41: Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126779.054129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789126779.054228:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276666880:0@lo:41: 00010000:00010000:1.0:1789126779.306869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789126779.722019:0:9004:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126779.722030:0:9004:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789126780.330812:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126781.356592:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126782.381751:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126782.635116:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276667008:0@lo:41: 00000100:00100000:3.0:1789126782.635199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126782.635272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667008 00000100:00100000:3.0:1789126782.635280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667008 00000100:00100000:3.0:1789126782.635328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789126782.635337:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276667008:12345-0@lo:41: 00000004:00000024:3.0:1789126782.635371:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789126782.635418:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276667008:12345-0@lo:41: Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126782.635424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789126782.635469:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276667008:0@lo:41: 00000100:00100000:0.0:1789126783.147082:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276667136:0@lo:400: 00000100:00100000:3.0:1789126783.147234:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276667392:0@lo:400: 00000100:00100000:3.0:1789126783.147323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126783.147373:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276667904:0@lo:400: 00000100:00100000:3.0:1789126783.147414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126783.147438:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789126783.147444:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276667520:0@lo:400: 00000100:00100000:3.0:1789126783.147465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126783.147483:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276668032:0@lo:400: 00000100:00100000:3.0:1789126783.147507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126783.147546:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667392 00000100:00100000:3.0:1789126783.147553:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667392 00000100:00100000:3.0:1789126783.147596:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789126783.147606:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276667392:12345-0@lo:400: 00000100:00100000:3.0:1789126783.147676:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276667392:12345-0@lo:400: Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.147684:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789126783.147705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667904 00000100:00100000:3.0:1789126783.147709:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667904 00000100:00100000:3.0:1789126783.147741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667520 00000100:00100000:3.0:1789126783.147744:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667520 00000100:00100000:3.0:1789126783.147757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789126783.147763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276667904:12345-0@lo:400: 00000100:00100000:3.0:1789126783.147792:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276667904:12345-0@lo:400: Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.147798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789126783.147809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789126783.147815:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276667520:12345-0@lo:400: 00000100:00100000:3.0:1789126783.147841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276667520:12345-0@lo:400: Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.147853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789126783.147876:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668032 00000100:00100000:3.0:1789126783.147880:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668032 00000100:00100000:3.0:1789126783.147906:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789126783.147912:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276668032:12345-0@lo:400: 00000100:00100000:3.0:1789126783.147941:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276668032:12345-0@lo:400: Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.147948:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789126783.147966:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126783.147970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789126783.147998:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420a88d680 x1876035276667520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126783.148011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276667520:0@lo:400: 00010000:00080000:3.0:1789126783.148022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420a88c780 x1876035276668032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126783.148041:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789126783.148054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276668032:0@lo:400: 00000100:00100000:3.0:1789126783.148065:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276667392:0@lo:400: 00010000:00080000:3.0:1789126783.148074:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420a88f0c0 x1876035276667904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126783.148082:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276667904:0@lo:400: 00000100:00100000:0.0:1789126783.148224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126783.148254:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276667648:0@lo:400: 00000100:00100000:0.0:1789126783.148281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126783.148307:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276668160:0@lo:400: 00000100:00100000:0.0:1789126783.148329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126783.148348:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789126783.148361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276667264:0@lo:400: 00000100:00100000:0.0:1789126783.148385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126783.148397:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276667776:0@lo:400: 00000100:00100000:0.0:1789126783.148417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126783.148437:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276668288:0@lo:13: 00000100:00100000:2.0:1789126783.148438:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667264 00000100:00100000:2.0:1789126783.148442:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667264 00000100:00100000:0.0:1789126783.148456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126783.148465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667776 00000100:00100000:2.0:1789126783.148468:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667776 00000100:00100000:0.0:1789126783.148483:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668160 00000100:00100000:2.0:1789126783.148485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789126783.148486:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668160 00000100:00100000:2.0:1789126783.148491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276667264:12345-0@lo:400: 00000100:00100000:0.0:1789126783.148509:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789126783.148515:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276668160:12345-0@lo:400: 00000100:00100000:2.0:1789126783.148530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276667264:12345-0@lo:400: Request processed in 39us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126783.148536:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789126783.148539:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276668160:12345-0@lo:400: Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126783.148544:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789126783.148547:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789126783.148553:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276667776:12345-0@lo:400: 00000100:00100000:0.0:1789126783.148558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667136 00000100:00100000:0.0:1789126783.148561:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667136 00000100:00100000:2.0:1789126783.148578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276667776:12345-0@lo:400: Request processed in 25us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126783.148583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126783.148602:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789126783.148609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:3641:x1876035276667136:12345-0@lo:400: 00000100:00100000:0.0:1789126783.148638:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:3641:x1876035276667136:12345-0@lo:400: Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126783.148644:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789126783.148692:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668288 00000100:00100000:0.0:1789126783.148696:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668288 00000100:00100000:0.0:1789126783.148717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789126783.148723:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276668288:12345-0@lo:13: 00002000:00000024:0.0:1789126783.148742:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126783.148769:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276668288:12345-0@lo:13: Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126783.148784:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789126783.148811:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee12c0 x1876035276667264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126783.148820:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276667264:0@lo:400: 00010000:00080000:0.0:1789126783.148829:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420a88c3c0 x1876035276667776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126783.148836:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276667776:0@lo:400: 00010000:00080000:0.0:1789126783.148845:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f99d680 x1876035276668288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126783.148851:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789126783.148864:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276668288:0@lo:13: 00000100:00100000:0.0:1789126783.148874:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276667136:0@lo:400: 00010000:00080000:0.0:1789126783.148882:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e7480 x1876035276668160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126783.148889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276668160:0@lo:400: 00000100:00100000:3.0:1789126783.149087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276667648 00000100:00100000:3.0:1789126783.149092:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276667648 00000100:00100000:3.0:1789126783.149126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789126783.149132:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276667648:12345-0@lo:400: 00000100:00100000:3.0:1789126783.149193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276667648:12345-0@lo:400: Request processed in 60us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.149199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789126783.149220:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126783.149229:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276668416:0@lo:13: 00000100:00100000:3.0:1789126783.149256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126783.149279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668416 00000100:00100000:3.0:1789126783.149282:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668416 00000100:00100000:3.0:1789126783.149304:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789126783.149310:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276668416:12345-0@lo:13: 00002000:00000024:3.0:1789126783.149320:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126783.149349:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276668416:12345-0@lo:13: Request processed in 40us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126783.149355:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789126783.149369:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126783.149373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789126783.149389:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f840 x1876035276668416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126783.149402:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276668416:0@lo:13: 00000100:00100000:3.0:1789126783.149429:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276667648:0@lo:400: 00010000:00010000:0.0:1789126783.402881:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126784.176227:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276668544:0@lo:41: 00000100:00100000:3.0:1789126784.176309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126784.176387:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668544 00000100:00100000:2.0:1789126784.176402:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668544 00000100:00100000:2.0:1789126784.176477:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126784.176498:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276668544:12345-0@lo:41: 00000004:00000024:2.0:1789126784.176539:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789126784.176786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276668544:12345-0@lo:41: Request processed in 298us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126784.176796:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789126784.176895:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276668544:0@lo:41: 00010000:00010000:2.0:1789126784.427003:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126785.452619:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126786.475122:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126787.499283:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126787.754829:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126787.754856:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276668672:0@lo:41: 00000100:00100000:0.0:1789126787.754930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126787.754973:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668672 00000100:00100000:3.0:1789126787.754981:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668672 00000100:00100000:3.0:1789126787.755038:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789126787.755049:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276668672:12345-0@lo:41: 00000004:00000024:3.0:1789126787.755100:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789126787.755156:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276668672:12345-0@lo:41: Request processed in 109us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126787.755164:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789126787.756013:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276668672:0@lo:41: 00000020:01000004:0.0:1789126788.034940:0:9503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789126788.034944:0:9503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789126788.034946:0:9503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789126788.035068:0:9503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994102d1e800 00000020:01000004:0.0:1789126788.035084:0:9503:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789126788.035098:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789126788.035110:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99422d560000) 00000020:00000080:0.0:1789126788.036975:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789126788.104437:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789126788.104565:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1789126788.127828:0:9503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789126788.128922:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789126788.128938:0:9503:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789126788.129633:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ea7f4 00000020:01000004:0.0:1789126788.129642:0:9503:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789126788.129685:0:9503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789126788.129689:0:9503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789126788.129697:0:9503:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789126788.129725:0:9503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789126788.129729:0:9503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789126788.155624:0:9503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789126788.155832:0:9503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789126788.155836:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789126788.155843:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789126788.155845:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789126788.155934:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789126788.155935:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789126788.155936:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789126788.155938:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789126788.155940:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789126788.155941:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789126788.155942:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789126788.155944:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789126788.155947:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789126788.155950:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789126788.155951:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789126788.155952:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789126788.155953:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789126788.155954:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789126788.155955:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789126788.155956:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789126788.155957:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789126788.155958:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789126788.155959:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789126788.155960:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789126788.155983:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789126788.156009:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276668800:0@lo:253: 00000100:00100000:2.0:1789126788.156085:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.156226:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118840 going to sleep for 11 seconds 00000100:00100000:3.0:1789126788.156270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668800 00000100:00100000:3.0:1789126788.156278:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668800 00000100:00100000:3.0:1789126788.156370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789126788.156381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:9503:x1876035276668800:12345-0@lo:253: 20000000:01000000:3.0:1789126788.156410:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789126788.156414:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789126788.156419:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789126788.156422:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789126788.156674:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789126788.156798:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789126788.156813:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789126788.156831:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789126788.156837:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789126788.156863:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789126788.156881:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789126788.156967:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789126788.156982:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1789126788.156984:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789126788.157009:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789126788.157016:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789126788.157031:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789126788.157037:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1789126788.157050:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789126788.157057:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789126788.157071:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789126788.157089:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789126788.157251:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789126788.157263:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1789126788.157264:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789126788.157279:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789126788.157285:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789126788.157299:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789126788.157305:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1789126788.157319:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789126788.157324:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789126788.157336:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789126788.157351:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789126788.157742:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789126788.157755:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:3.0:1789126788.157757:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789126788.157772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789126788.157777:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789126788.157791:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789126788.157796:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1789126788.157808:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789126788.157813:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789126788.157825:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789126788.157840:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789126788.157853:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789126788.157855:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789126788.157859:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789126788.157899:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789126788.157902:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789126788.158598:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789126788.158630:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789126788.158642:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789126788.158934:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789126788.158956:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789126788.158972:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789126788.158985:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789126788.158987:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789126788.159391:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1789126788.159588:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1789126788.159619:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1789126788.159636:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1789126788.159758:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789126788.159761:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126788.160226:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126788.160247:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126788.160264:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789126788.160422:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789126788.160443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789126788.160460:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789126788.160469:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789126788.160471:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126788.161110:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126788.161200:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126788.161216:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789126788.161349:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789126788.161368:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789126788.161385:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1789126788.161394:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789126788.161396:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789126788.161823:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789126788.161843:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789126788.161930:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789126788.162086:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789126788.162107:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789126788.162198:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1789126788.162214:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789126788.162234:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162252:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162261:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea714 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162267:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea753 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162273:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea76f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162292:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea799 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162299:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162306:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162314:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162349:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162365:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.162379:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276668928:0@lo:104: 00000100:00100000:3.0:1789126788.162446:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126788.162602:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162611:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.162620:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669056:0@lo:104: 00000100:00100000:3.0:1789126788.162643:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126788.162911:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.162927:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 21 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.162935:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669184:0@lo:104: 00000100:00100000:3.0:1789126788.162960:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.163009:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276668928 00000100:00100000:2.0:1789126788.163016:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276668928 00000100:00100000:2.0:1789126788.163050:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669056 00000100:00100000:2.0:1789126788.163054:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669056 00000100:00100000:2.0:1789126788.163068:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789126788.163084:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276668928:12345-0@lo:104: 00010000:00010000:2.0:1789126788.163096:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.163168:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126788.163173:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276668928:12345-0@lo:104: Request processed in 91us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.163180:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789126788.163196:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789126788.163203:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669056:12345-0@lo:104: 00010000:00010000:2.0:1789126788.163211:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.163242:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126788.163247:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669056:12345-0@lo:104: Request processed in 45us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.163252:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789126788.163414:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126788.163422:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163429:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126788.163433:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163442:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126788.163461:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126788.163467:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126788.163511:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163518:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126788.163537:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163544:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666ea7d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163558:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126788.163561:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163567:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126788.163570:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163576:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126788.163582:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126788.163587:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126788.163609:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163615:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126788.163633:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163640:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea7b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163684:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126788.163687:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126788.163688:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126788.163694:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126788.163706:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276669312:0@lo:103: 00000100:00100000:0.0:1789126788.163737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.163769:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126788.163777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276669440:0@lo:103: 00000100:00100000:0.0:1789126788.163801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.163837:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669312 00000100:00100000:0.0:1789126788.163841:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669312 00010000:00010000:0.0:1789126788.163875:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 22 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.163896:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669440 00000100:00100000:0.0:1789126788.163899:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669440 00010000:00010000:0.0:1789126788.163910:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 23 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.163928:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789126788.163935:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276669312:12345-0@lo:103: 00010000:00010000:0.0:1789126788.163952:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.163958:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 23 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163968:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 23 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.163983:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.164022:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276669312:12345-0@lo:103: Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.164028:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789126788.164042:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789126788.164048:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+22:3640:x1876035276669440:12345-0@lo:103: 00010000:00010000:0.0:1789126788.164055:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.164060:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 22 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.164068:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 22 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.164078:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.164104:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+22:3640:x1876035276669440:12345-0@lo:103: Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.164110:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789126788.164161:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276669312:0@lo:103: 00000100:00100000:0.0:1789126788.164188:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276669440:0@lo:103: 00010000:00010000:3.0:1789126788.164521:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.164532:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 21 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.164541:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669184 00000100:00100000:3.0:1789126788.164542:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669568:0@lo:104: 00000100:00100000:2.0:1789126788.164544:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669184 00000100:00100000:2.0:1789126788.164565:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789126788.164568:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.164570:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669184:12345-0@lo:104: 00010000:00010000:2.0:1789126788.164579:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.164585:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.164592:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.164600:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669696:0@lo:104: 00010000:00010000:2.0:1789126788.164612:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126788.164616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669184:12345-0@lo:104: Request processed in 47us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.164622:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789126788.164634:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.164638:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669568 00000100:00100000:2.0:1789126788.164641:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669568 00010000:00010000:3.0:1789126788.164668:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.164671:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669696 00000100:00100000:2.0:1789126788.164674:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669696 00010000:00010000:3.0:1789126788.164677:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.164683:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789126788.164685:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669824:0@lo:104: 00000100:00100000:2.0:1789126788.164688:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276669568:12345-0@lo:104: 00010000:00010000:2.0:1789126788.164695:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.164713:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126788.164721:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126788.164725:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276669568:12345-0@lo:104: Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.164731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789126788.164734:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.164742:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 21 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.164746:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789126788.164750:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669952:0@lo:104: 00000100:00100000:2.0:1789126788.164754:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669824 00000100:00100000:2.0:1789126788.164757:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669824 00000100:00100000:2.0:1789126788.164769:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126788.164775:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276669696:12345-0@lo:104: 00010000:00010000:2.0:1789126788.164782:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.164820:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789126788.164826:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:6506:x1876035276669696:12345-0@lo:104: Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.164831:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789126788.164907:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789126788.164918:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669824:12345-0@lo:104: 00010000:00010000:2.0:1789126788.164926:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.164959:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789126788.164964:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669824:12345-0@lo:104: Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.164970:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789126788.166207:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126788.166253:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a703c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789126788.166275:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ec00/0xa840b4da666ea7df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea7d8 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.166288:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276668928:0@lo:104: 00010000:00010000:3.0:1789126788.166470:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea7bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea7b5 expref: 20 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.166480:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669056:0@lo:104: 00000100:00100000:3.0:1789126788.166493:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669184:0@lo:104: 00000100:00100000:3.0:1789126788.166500:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669568:0@lo:104: 00000100:00100000:3.0:1789126788.166507:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669696:0@lo:104: 00000100:00100000:3.0:1789126788.166514:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669824:0@lo:104: 00000100:00100000:2.0:1789126788.166582:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276669952 00000100:00100000:2.0:1789126788.166588:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276669952 00000100:00100000:2.0:1789126788.166620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789126788.166628:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669952:12345-0@lo:104: 00010000:00010000:2.0:1789126788.166639:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.166680:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789126788.166687:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.166694:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166ac00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126788.166697:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.166701:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789126788.166706:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:6506:x1876035276669952:12345-0@lo:104: Request processed in 79us (1938us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126788.166706:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.166713:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:00010000:1.0:1789126788.166714:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126788.166734:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789126788.166888:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876035276669952:0@lo:104: 00010000:00010000:3.0:1789126788.166921:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.166926:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789126788.167315:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789126788.167582:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167596:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126788.167599:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167607:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126788.167614:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126788.167618:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126788.167675:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167682:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126788.167699:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167707:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666ea76f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea776 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167719:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126788.167722:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167728:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148e200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126788.167731:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167748:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126788.167755:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126788.167760:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126788.167775:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167781:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126788.167794:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167799:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea71b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167809:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126788.167812:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167817:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126788.167820:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167826:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126788.167833:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126788.167843:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126788.167868:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167874:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126788.167880:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167885:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666ea6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6f1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.167895:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126788.167896:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126788.167898:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126788.167906:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126788.167920:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670080:0@lo:103: 00000100:00100000:0.0:1789126788.167964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.168014:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276670208:0@lo:103: 00000100:00100000:0.0:1789126788.168040:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.168056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126788.168061:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276670336:0@lo:103: 00000100:00100000:0.0:1789126788.168081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.168103:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670080 00000100:00100000:0.0:1789126788.168107:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670080 00010000:00010000:0.0:1789126788.168273:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 20 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.168301:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670208 00000100:00100000:0.0:1789126788.168312:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670208 00010000:00010000:0.0:1789126788.168331:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 21 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.168346:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670336 00000100:00100000:0.0:1789126788.168350:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670336 00010000:00010000:0.0:1789126788.168362:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 22 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.168375:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789126788.168383:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276670080:12345-0@lo:103: 00010000:00010000:0.0:1789126788.168396:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.168403:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 22 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168414:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 22 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168431:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588200/0xa840b4da666ea776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea76f expref: 22 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168446:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.168581:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+21:3639:x1876035276670080:12345-0@lo:103: Request processed in 198us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.168589:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789126788.168604:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789126788.168611:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+20:3641:x1876035276670208:12345-0@lo:103: 00010000:00010000:0.0:1789126788.168619:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.168624:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 20 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168644:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 20 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168683:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588000/0xa840b4da666ea71b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea714 expref: 20 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168692:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.168722:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+19:3641:x1876035276670208:12345-0@lo:103: Request processed in 111us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.168728:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789126788.168763:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789126788.168770:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+18:3641:x1876035276670336:12345-0@lo:103: 00010000:00010000:0.0:1789126788.168777:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.168782:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 18 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168789:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 18 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168798:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ee00/0xa840b4da666ea6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea6ea expref: 18 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.168807:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.168829:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3641:x1876035276670336:12345-0@lo:103: Request processed in 60us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.168836:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789126788.168945:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276670336:0@lo:103: 00000100:00100000:0.0:1789126788.168955:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276670208:0@lo:103: 00000100:00100000:0.0:1789126788.168987:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670080:0@lo:103: 00010000:00010000:3.0:1789126788.169320:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126788.169323:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126788.169325:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126788.169351:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.169359:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126788.169363:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.169370:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126788.169377:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126788.169393:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126788.169458:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.169466:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789126788.169564:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670464:0@lo:103: 00000100:00100000:0.0:1789126788.169597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126788.169646:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.169670:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666ea753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea75a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.169681:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126788.169683:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126788.169684:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126788.169768:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670464 00000100:00100000:0.0:1789126788.169773:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670464 00010000:00010000:0.0:1789126788.169792:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.169916:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789126788.169925:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3639:x1876035276670464:12345-0@lo:103: 00010000:00010000:0.0:1789126788.169934:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.169939:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.169948:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.169960:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588e00/0xa840b4da666ea75a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea753 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.169971:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.170050:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+16:3639:x1876035276670464:12345-0@lo:103: Request processed in 126us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.170057:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789126788.170176:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670464:0@lo:103: 00010000:00010000:1.0:1789126788.170323:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.170331:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789126788.170373:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789126788.170417:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.170426:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166ac00/0xa840b4da666ea799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7a0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.170439:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126788.170441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126788.170443:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126788.170600:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670592:0@lo:103: 00000100:00100000:2.0:1789126788.170632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.171000:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670592 00000100:00100000:0.0:1789126788.171005:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670592 00010000:00010000:0.0:1789126788.171024:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.171098:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789126788.171107:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+16:3639:x1876035276670592:12345-0@lo:103: 00010000:00010000:0.0:1789126788.171126:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126788.171132:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171143:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171156:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f200/0xa840b4da666ea7a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea799 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171169:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171176:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171189:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171196:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171203:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171210:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171226:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126788.171230:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171237:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171257:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.171268:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.171305:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+15:3639:x1876035276670592:12345-0@lo:103: Request processed in 200us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.171311:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789126788.171350:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.171359:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.171365:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ea00/0xa840b4da666ea7fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789126788.171378:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789126788.172792:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276670592:0@lo:103: 00000100:00100000:3.0:1789126788.175800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+14:9503:x1876035276668800:12345-0@lo:253: Request processed in 19412us (19706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.175814:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789126788.175948:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276668800:0@lo:253: 10000000:01000000:2.0:1789126788.175963:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789126788.175966:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789126788.175968:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789126788.175969:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789126788.175971:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789126788.175972:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789126788.175973:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789126788.175975:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789126788.175988:0:9503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789126788.175998:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789126788.176000:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789126788.176020:0:9503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994102d1e800 from lustre-OST0001 10000000:01000000:2.0:1789126788.176050:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789126788.176053:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789126788.176061:0:9503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f0000 local copy 10000000:01000000:2.0:1789126788.176065:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789126788.176100:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.176110:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.176188:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.176208:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670720:0@lo:101: 00000100:00100000:2.0:1789126788.176246:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.176317:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126788.176357:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670720 00000100:00100000:3.0:1789126788.176363:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670720 00000100:00100000:3.0:1789126788.176403:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789126788.176412:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+14:9503:x1876035276670720:12345-0@lo:101: 00010000:00010000:3.0:1789126788.176424:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126788.176438:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ec00/0xa840b4da666ea809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea802 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.176461:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ec00/0xa840b4da666ea809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea802 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.176470:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ec00/0xa840b4da666ea809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea802 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.176480:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ec00, rc 0) 00000100:00100000:3.0:1789126788.176564:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276670720:12345-0@lo:101: Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.176570:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789126788.176635:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670720:0@lo:101: 00010000:00010000:2.0:1789126788.176759:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.176769:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.176935:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670848:0@lo:501: 00000100:00100000:2.0:1789126788.176963:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.177026:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126788.177058:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670848 00000100:00100000:3.0:1789126788.177062:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670848 00000100:00100000:3.0:1789126788.177088:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789126788.177094:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276670848:12345-0@lo:501: 00000100:00100000:3.0:1789126788.177257:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276670848:12345-0@lo:501: Request processed in 162us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789126788.177263:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789126788.177311:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670848:0@lo:501: 10000000:01000000:2.0:1789126788.177330:0:9503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789126788.177352:0:9503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789126788.177357:0:9503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.177364:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.177371:0:9503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.177435:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789126788.177463:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994102d1e800 10000000:01000000:2.0:1789126788.177469:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789126788.177475:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789126788.177478:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789126788.177481:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789126788.177484:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789126788.177502:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.177509:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.177517:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.177530:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670976:0@lo:101: 00000100:00100000:2.0:1789126788.177556:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.177586:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520540 going to sleep for 11 seconds 00000100:00100000:3.0:1789126788.177632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276670976 00000100:00100000:3.0:1789126788.177636:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276670976 00000100:00100000:3.0:1789126788.177688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789126788.177695:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276670976:12345-0@lo:101: 00010000:00010000:3.0:1789126788.177702:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126788.177713:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea810 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.177729:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea810 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.177736:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea810 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.177744:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f800, rc 0) 00000100:00100000:3.0:1789126788.177778:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276670976:12345-0@lo:101: Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.177783:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:1.0:1789126788.177977:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126788.177984:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.177999:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126788.178003:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.178012:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126788.178020:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126788.178025:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789126788.178046:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.178058:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789126788.178101:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276671104:0@lo:103: 00000100:00100000:2.0:1789126788.178138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789126788.178230:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.178237:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ea802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa840b4da666ea809 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.178249:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126788.178251:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126788.178252:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126788.178350:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671104 00000100:00100000:0.0:1789126788.178356:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276670976:0@lo:101: 00000100:00100000:3.0:1789126788.178363:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671104 00010000:00010000:0.0:1789126788.178371:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.178382:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126788.178410:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789126788.178418:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+16:3641:x1876035276671104:12345-0@lo:103: 00010000:00010000:3.0:1789126788.178428:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126788.178439:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ec00/0xa840b4da666ea809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea802 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.178451:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126788.178469:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671232:0@lo:501: 00000100:00100000:0.0:1789126788.178504:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.178530:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789126788.178547:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671232 00000100:00100000:1.0:1789126788.178552:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671232 00000100:00100000:1.0:1789126788.178586:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789126788.178593:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276671232:12345-0@lo:501: 00000100:00100000:1.0:1789126788.178714:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276671232:12345-0@lo:501: Request processed in 121us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126788.178720:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789126788.178916:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+15:3641:x1876035276671104:12345-0@lo:103: Request processed in 429us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.178924:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126788.178997:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276671104:0@lo:103: 00000100:00100000:0.0:1789126788.179060:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671232:0@lo:501: 00000100:00100000:0.0:1789126788.179090:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671360:0@lo:503: 00000100:00100000:0.0:1789126788.179131:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.179170:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.179203:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671360 00000100:00100000:2.0:1789126788.179208:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671360 00000100:00100000:2.0:1789126788.179241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789126788.179248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671360:12345-0@lo:503: 00000100:00100000:2.0:1789126788.179338:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671360:12345-0@lo:503: Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.179346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789126788.179372:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671360:0@lo:503: 00000040:00080000:0.0:1789126788.179594:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789126788.179690:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671488:0@lo:502: 00000100:00100000:0.0:1789126788.179725:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.179753:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126788.179796:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671488 00000100:00100000:3.0:1789126788.179801:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671488 00000100:00100000:3.0:1789126788.179825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789126788.179831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671488:12345-0@lo:502: 00000100:00100000:3.0:1789126788.180053:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671488:12345-0@lo:502: Request processed in 221us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.180060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789126788.180212:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671488:0@lo:502: 00000040:00080000:0.0:1789126788.180410:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789126788.180436:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789126788.180450:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789126788.180463:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789126788.180478:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789126788.180491:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789126788.180512:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671616:0@lo:502: 00000100:00100000:0.0:1789126788.180547:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.180607:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789126788.181253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671616 00000100:00100000:1.0:1789126788.181259:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671616 00000100:00100000:0.0:1789126788.181514:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789126788.181524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671616:12345-0@lo:502: 00000100:00100000:0.0:1789126788.181641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671616:12345-0@lo:502: Request processed in 118us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.181673:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789126788.181757:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671616:0@lo:502: 00000040:00080000:1.0:1789126788.181815:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789126788.181826:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789126788.182377:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789126788.182386:0:9516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789126788.182392:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126788.182395:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789126788.182402:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789126788.182416:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994102ebb490) 00000020:00000080:1.0:1789126788.182446:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789126788.182453:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789126788.182528:0:9516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994102d1e800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789126788.182536:0:9516:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789126788.182543:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ea825 00010000:00010000:1.0:1789126788.187374:0:9516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789126788.187824:0:9516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789126788.191592:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789126788.192493:0:9516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789126788.198221:0:9516:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789126788.198415:0:9516:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789126788.206679:0:9516:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789126788.210712:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789126788.210725:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126788.210732:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126788.210734:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789126788.210739:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789126788.210742:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126788.210744:0:9516:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789126788.210747:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789126788.210750:0:9516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789126788.210765:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126788.210767:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126788.210769:0:9516:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789126788.210772:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789126788.211551:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789126788.211586:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789126788.212954:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.212968:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126788.214215:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 1 10000000:01000000:1.0:1789126788.214218:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126788.214257:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.214266:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.214277:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126788.214301:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671744:0@lo:101: 00000100:00100000:1.0:1789126788.214369:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.214421:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.214576:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671744 00000100:00100000:2.0:1789126788.214583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671744 00000100:00100000:2.0:1789126788.214629:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789126788.214639:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:9503:x1876035276671744:12345-0@lo:101: 00010000:00010000:2.0:1789126788.214691:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126788.214707:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea82c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.214729:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea82c expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.214740:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea82c expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.214749:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3c00, rc 0) 00000100:00100000:2.0:1789126788.214794:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276671744:12345-0@lo:101: Request processed in 156us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.214801:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789126788.215062:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671744:0@lo:101: 00010000:00010000:1.0:1789126788.215080:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.215098:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126788.215224:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671872:0@lo:501: 00000100:00100000:1.0:1789126788.215254:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.215290:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.215389:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276671872 00000100:00100000:2.0:1789126788.215394:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276671872 00000100:00100000:2.0:1789126788.215425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789126788.215436:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276671872:12345-0@lo:501: 00000100:00100000:2.0:1789126788.215542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276671872:12345-0@lo:501: Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.215549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789126788.215952:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276671872:0@lo:501: 00000100:00100000:1.0:1789126788.215986:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672000:0@lo:503: 00000100:00100000:1.0:1789126788.216037:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.216065:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.216107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672000 00000100:00100000:2.0:1789126788.216118:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672000 00000100:00100000:2.0:1789126788.216149:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789126788.216157:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672000:12345-0@lo:503: 00000100:00100000:2.0:1789126788.216247:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672000:12345-0@lo:503: Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.216257:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789126788.216387:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672000:0@lo:503: 00000040:00080000:1.0:1789126788.216626:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789126788.216726:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672128:0@lo:502: 00000100:00100000:1.0:1789126788.216765:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.216781:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.216839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672128 00000100:00100000:2.0:1789126788.216843:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672128 00000100:00100000:2.0:1789126788.216883:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789126788.216890:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672128:12345-0@lo:502: 00000100:00100000:2.0:1789126788.216979:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672128:12345-0@lo:502: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.216985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789126788.217123:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672128:0@lo:502: 00000040:00080000:1.0:1789126788.217319:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789126788.217343:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789126788.217361:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672256:0@lo:502: 00000100:00100000:1.0:1789126788.217391:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.217422:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.217520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672256 00000100:00100000:2.0:1789126788.217524:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672256 00000100:00100000:2.0:1789126788.217548:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789126788.217555:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672256:12345-0@lo:502: 00000100:00100000:2.0:1789126788.217633:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672256:12345-0@lo:502: Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.217639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789126788.218675:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672256:0@lo:502: 00000040:00080000:1.0:1789126788.218738:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789126788.218748:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789126788.221550:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126788.221563:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126788.221566:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789126788.221572:0:9520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994102d1e800 00000020:00000080:1.0:1789126788.221575:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789126788.221585:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126788.221588:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126788.221589:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789126788.221593:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789126788.221908:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789126788.221935:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126788.221998:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.222011:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126788.222064:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789126788.222067:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994102d1e800 10000000:01000000:2.0:1789126788.222070:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994102d1e800 10000000:01000000:2.0:1789126788.222074:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789126788.222080:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994102d1e800 from 1 10000000:01000000:2.0:1789126788.222083:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789126788.222195:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.222216:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.222227:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.222249:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672384:0@lo:101: 00000100:00100000:2.0:1789126788.222315:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.222407:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789126788.222468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672384 00000100:00100000:0.0:1789126788.222475:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672384 00000100:00100000:0.0:1789126788.222552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789126788.222562:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:9503:x1876035276672384:12345-0@lo:101: 00010000:00010000:0.0:1789126788.222574:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126788.222588:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea83a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.222619:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea83a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.222628:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea83a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126788.222637:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031c00, rc 0) 00000100:00100000:0.0:1789126788.222711:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672384:12345-0@lo:101: Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.222718:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789126788.222815:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672384:0@lo:101: 00010000:00010000:1.0:1789126788.222828:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.222837:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126788.222926:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672512:0@lo:501: 00000100:00100000:1.0:1789126788.222955:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.226311:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.228444:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672512 00000100:00100000:2.0:1789126788.228459:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672512 00000100:00100000:2.0:1789126788.228523:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789126788.228533:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672512:12345-0@lo:501: 00000100:00100000:1.0:1789126788.228819:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672512:0@lo:501: 00000100:00100000:1.0:1789126788.228937:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672640:0@lo:503: 00000100:00100000:2.0:1789126788.229645:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672512:12345-0@lo:501: Request processed in 1110us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.229690:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789126788.230319:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.230368:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.231063:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672640 00000100:00100000:2.0:1789126788.231072:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672640 00000100:00100000:2.0:1789126788.231114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789126788.231122:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672640:12345-0@lo:503: 00000100:00100000:2.0:1789126788.231257:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672640:12345-0@lo:503: Request processed in 135us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.231264:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789126788.231304:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672640:0@lo:503: 00000040:00080000:1.0:1789126788.231542:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789126788.231616:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672768:0@lo:502: 00000100:00100000:1.0:1789126788.232090:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.232193:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.233627:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672768 00000100:00100000:2.0:1789126788.233639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672768 00000100:00100000:2.0:1789126788.233824:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789126788.233834:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672768:12345-0@lo:502: 00000100:00100000:2.0:1789126788.234208:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672768:12345-0@lo:502: Request processed in 374us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.234219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789126788.234256:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672768:0@lo:502: 00000040:00080000:1.0:1789126788.234541:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789126788.234577:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789126788.234595:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789126788.234610:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789126788.234625:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789126788.234638:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789126788.234681:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789126788.234700:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789126788.234719:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789126788.234737:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789126788.234752:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789126788.234766:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789126788.234782:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789126788.234796:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789126788.234809:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789126788.234823:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789126788.234837:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789126788.234865:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789126788.234882:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789126788.234896:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789126788.234907:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789126788.234919:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789126788.234930:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789126788.234943:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789126788.234957:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789126788.234973:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789126788.234987:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789126788.235030:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789126788.235045:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789126788.235058:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789126788.235071:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789126788.235094:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789126788.235109:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789126788.235264:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789126788.235282:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789126788.235298:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789126788.235313:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789126788.235328:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789126788.235343:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789126788.235359:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789126788.235372:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789126788.235385:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789126788.235399:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789126788.235426:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789126788.235443:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789126788.235458:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789126788.235497:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672896:0@lo:502: 00000100:00100000:1.0:1789126788.235558:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.235609:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.235701:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276672896 00000100:00100000:2.0:1789126788.235709:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276672896 00000100:00100000:2.0:1789126788.235757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789126788.235767:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672896:12345-0@lo:502: 00000100:00100000:2.0:1789126788.235971:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276672896:12345-0@lo:502: Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.235979:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789126788.236058:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276672896:0@lo:502: 00000040:00080000:1.0:1789126788.236102:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789126788.236110:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789126788.237938:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789126788.237955:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff994102ebced8) 00000020:00000080:1.0:1789126788.237980:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789126788.238086:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994102d1e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789126788.238091:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994102d1e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789126788.238093:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994102d1e800 3 00010000:00080000:1.0:1789126788.238134:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102d0d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789126788.241576:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789126788.242207:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789126788.242266:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789126788.242279:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa840b4da666ea84f 00000100:00080000:1.0:1789126788.242289:0:9521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126788.242294:0:9521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102d0d000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126788.242330:0:9521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423675c780 x1876035276673024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126788.242396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276673024:0@lo:38: 00000100:00100000:0.0:1789126788.242467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126788.242553:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673024 00000100:00100000:3.0:1789126788.242561:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673024 00000100:00100000:3.0:1789126788.242596:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789126788.242604:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276673024:12345-0@lo:38: 00010000:00080000:3.0:1789126788.242628:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1789126788.242677:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa840b4da666ea856 00000004:00100000:3.0:1789126788.242692:0:6513:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789126788.242729:0:6513:0:(import.c:65:import_set_state_nolock()) ffff99422d6be800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789126788.243122:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789126788.248326:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276673536:0@lo:400: 00000100:00100000:0.0:1789126788.248406:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248442:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276674048:0@lo:400: 00000100:00100000:0.0:1789126788.248469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248498:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789126788.248505:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276673152:0@lo:400: 00000100:00100000:0.0:1789126788.248534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248555:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276673664:0@lo:400: 00000100:00100000:0.0:1789126788.248576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248608:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276673280:0@lo:400: 00000100:00100000:0.0:1789126788.248640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248679:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276673792:0@lo:400: 00000100:00100000:0.0:1789126788.248698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248717:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789126788.248723:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276673408:0@lo:400: 00000100:00100000:1.0:1789126788.248731:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674048 00000100:00100000:1.0:1789126788.248739:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674048 00000100:00100000:0.0:1789126788.248755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.248768:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276673920:0@lo:400: 00000100:00100000:0.0:1789126788.248790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.248802:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673920 00000100:00100000:1.0:1789126788.248807:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673920 00000100:00100000:0.0:1789126788.248829:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.248837:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789126788.248844:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789126788.248855:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276674048:12345-0@lo:400: 00000100:00100000:0.0:1789126788.248867:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.248876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673152 00000100:00100000:0.0:1789126788.248879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673152 00000100:00100000:0.0:1789126788.248907:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.248912:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673664 00000100:00100000:0.0:1789126788.248914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673664 00000100:00100000:1.0:1789126788.248928:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276674048:12345-0@lo:400: Request processed in 74us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.248930:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.248939:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673792 00000100:00100000:1.0:1789126788.248941:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789126788.248943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673792 00000100:00100000:0.0:1789126788.248958:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.248962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673408 00000100:00100000:0.0:1789126788.248964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673408 00000100:00100000:1.0:1789126788.248968:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789126788.248974:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789126788.248979:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276673920:12345-0@lo:400: 00000100:00100000:0.0:1789126788.249001:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126788.249011:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276673152:12345-0@lo:400: 00000100:00100000:1.0:1789126788.249031:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276673920:12345-0@lo:400: Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126788.249039:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789126788.249054:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276673152:12345-0@lo:400: Request processed in 45us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126788.249061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673536 00000100:00100000:0.0:1789126788.249063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789126788.249067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673536 00000100:00100000:1.0:1789126788.249093:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276673280 00000100:00100000:1.0:1789126788.249096:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276673280 00000100:00100000:0.0:1789126788.249097:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.249106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126788.249114:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276673664:12345-0@lo:400: 00000100:00100000:0.0:1789126788.249142:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276673664:12345-0@lo:400: Request processed in 29us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.249157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126788.249170:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.249175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126788.249181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276673792:12345-0@lo:400: 00000100:00100000:0.0:1789126788.249209:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276673792:12345-0@lo:400: Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.249214:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126788.249223:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789126788.249229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126788.249237:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276673408:12345-0@lo:400: 00000100:00100000:1.0:1789126788.249242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789126788.249258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276673536:12345-0@lo:400: 00000100:00100000:0.0:1789126788.249293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276673408:12345-0@lo:400: Request processed in 56us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.249301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789126788.249312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276673536:12345-0@lo:400: Request processed in 56us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.249327:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789126788.249335:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276673280:12345-0@lo:400: 00000100:00100000:0.0:1789126788.249367:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276673280:12345-0@lo:400: Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126788.249466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789126788.249504:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789126788.249627:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e6d00 x1876035276673408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249641:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276673408:0@lo:400: 00010000:00080000:0.0:1789126788.249673:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e7840 x1876035276673920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249682:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276673920:0@lo:400: 00000100:00100000:0.0:1789126788.249693:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276673280:0@lo:400: 00010000:00080000:0.0:1789126788.249713:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e5a40 x1876035276673792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249721:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276673792:0@lo:400: 00010000:00080000:0.0:1789126788.249761:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e7c00 x1876035276673152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249769:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276673152:0@lo:400: 00010000:00080000:0.0:1789126788.249779:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e52c0 x1876035276673664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249788:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276673664:0@lo:400: 00000100:00100000:0.0:1789126788.249799:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276673536:0@lo:400: 00010000:00080000:0.0:1789126788.249812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99422f9e6580 x1876035276674048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.249820:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276674048:0@lo:400: 00000020:01000004:0.0:1789126788.251016:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789126788.251045:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff994103ec9a48) 00000020:00000080:0.0:1789126788.251080:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789126788.251156:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994102d1e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789126788.251161:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994102d1e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789126788.251164:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994102d1e800 3 00010000:00080000:0.0:1789126788.251204:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102d0e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789126788.253471:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:2.0:1789126788.254162:0:9523:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff99423664e580 x1876035276674176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126788.254174:0:9523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 0 seconds 00000100:00100000:3.0:1789126788.254346:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876035276673024:12345-0@lo:38: Request processed in 11738us (11876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.254363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789126788.254406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126788.254418:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126788.254422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789126788.254447:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423675c780 x1876035276673024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126788.254459:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789126788.254467:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789126788.254474:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789126788.254479:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789126788.254483:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789126788.254491:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000028635e6b): req@ffff99423664e580 x1876035276674176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126788.254510:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276673024:0@lo:38: 00000100:00100000:3.0:1789126788.254596:0:9523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126788.254627:0:9523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.254702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674176 00000100:00100000:2.0:1789126788.254709:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674176 00000100:00100000:2.0:1789126788.254759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789126788.254774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876035276674176:12345-0@lo:901: 00000100:00100000:2.0:1789126788.254873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876035276674176:12345-0@lo:901: Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.254881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789126788.254921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789126788.254981:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664e580 x1876035276674176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789126804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126788.255001:0:9523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1876035276674176:0@lo:901: 00000020:00000080:2.0:1789126788.255861:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789126788.255917:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789126788.255930:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa840b4da666ea864 00000100:00080000:2.0:1789126788.255940:0:9521:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789126788.255946:0:9521:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff994102d0e000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789126788.255973:0:9521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664c780 x1876035276674304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789126788.256006:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789126788.256038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276674304:0@lo:38: 00000100:00100000:3.0:1789126788.256090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.256134:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674304 00000100:00100000:2.0:1789126788.256139:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674304 00000100:00100000:2.0:1789126788.256165:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789126788.256172:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276674304:12345-0@lo:38: 00010000:00080000:2.0:1789126788.256192:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1789126788.256223:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa840b4da666ea86b 00000004:00100000:2.0:1789126788.256238:0:6512:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789126788.256269:0:6512:0:(import.c:65:import_set_state_nolock()) ffff99422f9ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126788.256323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876035276674304:12345-0@lo:38: Request processed in 150us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.256330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789126788.256387:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664c780 x1876035276674304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789126798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126788.256396:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789126788.256403:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789126788.256409:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789126788.256414:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789126788.256416:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789126788.256422:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276674304:0@lo:38: 00000040:00080000:3.0:1789126788.260274:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789126788.260414:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789126788.260439:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789126788.260487:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.260515:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789126788.260563:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789126788.260565:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789126788.260567:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789126788.260568:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789126788.260569:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789126788.260571:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789126788.260572:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789126788.260574:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789126788.260575:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789126788.260577:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789126788.260579:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789126788.260582:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789126788.260584:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789126788.260586:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789126788.260587:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789126788.260588:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789126788.260589:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789126788.260590:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789126788.260591:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789126788.260592:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789126788.260592:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789126788.260593:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789126788.260595:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789126788.260619:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789126788.260636:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276674432:0@lo:253: 00000100:00100000:2.0:1789126788.262196:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.262242:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789126788.262268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674432 00000100:00100000:2.0:1789126788.262274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674432 00000100:00100000:2.0:1789126788.262324:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789126788.262334:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276674432:12345-0@lo:253: 20000000:01000000:2.0:1789126788.262374:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789126788.262388:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789126788.267711:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126788.267738:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276674560:0@lo:13: 00000100:00100000:0.0:1789126788.268030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.268087:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126788.268097:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276674688:0@lo:13: 00000100:00100000:2.0:1789126788.268129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126788.268169:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674560 00000100:00100000:0.0:1789126788.268177:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674560 00000100:00100000:0.0:1789126788.268216:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674688 00000100:00100000:0.0:1789126788.268220:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674688 00000100:00100000:3.0:1789126788.268237:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789126788.268250:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276674560:12345-0@lo:13: 00002000:00000024:3.0:1789126788.268283:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126788.268326:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276674560:12345-0@lo:13: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.268367:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789126788.268394:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789126788.268402:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276674688:12345-0@lo:13: 00002000:00000024:3.0:1789126788.268413:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126788.268450:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276674688:12345-0@lo:13: Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126788.268456:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789126788.268525:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664e580 x1876035276674688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126788.268542:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276674688:0@lo:13: 00010000:00080000:0.0:1789126788.268715:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420a88cf00 x1876035276674560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126788.268730:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276674560:0@lo:13: 20000000:01000000:0.0:1789126788.268835:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789126788.268852:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789126788.268940:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789126788.268944:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789126788.268961:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.268975:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.268983:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.269003:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.269031:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.269044:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.269056:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276674816:0@lo:104: 00000100:00100000:2.0:1789126788.269106:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126788.269146:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.269155:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.269163:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276674944:0@lo:104: 00000100:00100000:2.0:1789126788.269183:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126788.269185:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674816 00000100:00100000:1.0:1789126788.269193:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674816 00000100:00100000:2.0:1789126788.269202:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789126788.269220:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276674944 00000100:00100000:1.0:1789126788.269224:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276674944 00000100:00100000:1.0:1789126788.269236:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789126788.269243:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276674816:12345-0@lo:104: 00010000:00010000:1.0:1789126788.269255:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126788.269317:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789126788.269324:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:6528:x1876035276674816:12345-0@lo:104: Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126788.269330:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789126788.269349:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789126788.269358:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276674944:12345-0@lo:104: 00000100:00100000:0.0:1789126788.269367:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:9503:x1876035276674432:12345-0@lo:253: Request processed in 7033us (7175us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126788.269368:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126788.269382:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1789126788.269421:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789126788.269429:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:6528:x1876035276674944:12345-0@lo:104: Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126788.269429:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:def09dbb-e047-4ff8-a277-077b6777bba2:9503:1876035276674432:0@lo:253: 00000100:00100000:1.0:1789126788.269441:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:0.0:1789126788.269444:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789126788.269448:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789126788.269450:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789126788.269451:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789126788.269453:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789126788.269454:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789126788.269456:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789126788.269458:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789126788.269460:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789126788.269461:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789126788.269463:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789126788.269464:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789126788.269474:0:9503:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789126788.270163:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789126788.270171:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270179:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126788.270183:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270192:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126788.270199:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126788.270205:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126788.270246:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270252:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126788.270269:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270288:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666ea7a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea7ae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270302:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126788.270306:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270311:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126788.270314:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270320:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126788.270326:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126788.270331:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789126788.270344:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270349:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126788.270363:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270370:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ea761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270382:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126788.270389:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126788.270391:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126788.270399:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126788.270411:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276675200:0@lo:103: 00000100:00100000:2.0:1789126788.270463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126788.270511:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675200 00000100:00100000:2.0:1789126788.270517:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675200 00010000:00010000:2.0:1789126788.270539:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126788.270545:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126788.270565:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789126788.270573:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+17:3642:x1876035276675200:12345-0@lo:103: 00010000:00010000:2.0:1789126788.270583:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126788.270588:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270597:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270612:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126788.270644:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+17:3642:x1876035276675200:12345-0@lo:103: Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.270680:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789126788.270703:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276675072:0@lo:103: 00000100:00100000:2.0:1789126788.270730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126788.270771:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276675200:0@lo:103: 00000100:00100000:2.0:1789126788.270775:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675072 00000100:00100000:2.0:1789126788.270780:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675072 00010000:00010000:2.0:1789126788.270796:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.270831:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789126788.270839:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3640:x1876035276675072:12345-0@lo:103: 00010000:00010000:2.0:1789126788.270847:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126788.270851:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270861:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 17 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270877:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270884:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789126788.270899:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002708759s 00010000:00010000:2.0:1789126788.270903:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270911:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270917:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270928:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270935:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126788.270938:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270952:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270961:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.270970:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126788.271008:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+17:3640:x1876035276675072:12345-0@lo:103: Request processed in 171us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126788.271015:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789126788.271042:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166be00/0xa840b4da666ea7ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea7a7 expref: 16 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.271052:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276674816:0@lo:104: 00010000:00010000:2.0:1789126788.271062:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030000/0xa840b4da666ea768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea761 expref: 15 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.271187:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876035276674944:0@lo:104: 00010000:00010000:2.0:1789126788.271201:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.271209:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.271215:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126788.271222:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3a00/0xa840b4da666ea872 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126788.271255:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276675072:0@lo:103: 00080000:10000000:0.0:1789126788.274602:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789126788.274925:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789126788.275334:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789126788.275525:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789126788.275885:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789126788.276245:0:9503:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789126788.277635:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789126788.284302:0:9503:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789126788.284311:0:9503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789126788.284348:0:9503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789126788.284387:0:9503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789126788.284406:0:9503:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789126788.284423:0:9503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789126788.285347:0:9503:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126788.285554:0:9503:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789126788.524455:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789126789.003934:0:9578:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126789.004192:0:9578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789126789.291337:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276675328:0@lo:41: 00000100:00100000:3.0:1789126789.291429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126789.291622:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675328 00000100:00100000:2.0:1789126789.291631:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675328 00000100:00100000:2.0:1789126789.291920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789126789.291931:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276675328:12345-0@lo:41: 00000004:00000024:2.0:1789126789.291965:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789126789.292110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276675328:12345-0@lo:41: Request processed in 181us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126789.292119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789126789.292152:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276675328:0@lo:41: 00010000:00010000:0.0:1789126789.547782:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126790.571033:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126791.595232:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126792.619346:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126792.874985:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126792.875010:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276675456:0@lo:41: 00000100:00100000:3.0:1789126792.875203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126792.875381:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675456 00000100:00100000:0.0:1789126792.875389:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675456 00000100:00100000:0.0:1789126792.875442:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789126792.875451:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276675456:12345-0@lo:41: 00000004:00000024:0.0:1789126792.875482:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789126792.875529:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276675456:12345-0@lo:41: Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126792.875536:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789126792.875578:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276675456:0@lo:41: 00000100:00100000:3.0:1789126793.386876:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789126793.387046:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276675584:0@lo:13: 00000100:00100000:3.0:1789126793.387189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.387309:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675584 00000100:00100000:0.0:1789126793.387317:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675584 00000100:00100000:0.0:1789126793.387418:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789126793.387429:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276675584:12345-0@lo:13: 00002000:00000024:0.0:1789126793.387458:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126793.387507:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276675584:12345-0@lo:13: Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.387515:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789126793.387562:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e580 x1876035276675584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.387579:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276675584:0@lo:13: 00000100:00100000:0.0:1789126793.391128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276675712:0@lo:400: 00000100:00100000:0.0:1789126793.391209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391251:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276676224:0@lo:400: 00000100:00100000:0.0:1789126793.391278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391304:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276676736:0@lo:400: 00000100:00100000:0.0:1789126793.391330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391358:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789126793.391364:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276675840:0@lo:400: 00000100:00100000:0.0:1789126793.391385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391402:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276676352:0@lo:400: 00000100:00100000:0.0:1789126793.391423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391439:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276676864:0@lo:13: 00000100:00100000:0.0:1789126793.391465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.391498:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675712 00000100:00100000:0.0:1789126793.391506:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675712 00000100:00100000:0.0:1789126793.391552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789126793.391560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:3641:x1876035276675712:12345-0@lo:400: 00000100:00100000:0.0:1789126793.391610:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+15:3641:x1876035276675712:12345-0@lo:400: Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.391618:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789126793.391671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676224 00000100:00100000:0.0:1789126793.391676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676224 00000100:00100000:2.0:1789126793.393616:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676736 00000100:00100000:2.0:1789126793.393629:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676736 00000100:00080000:3.0:1789126793.393758:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126793.393783:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126793.393788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126793.396538:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675840 00000100:00100000:0.0:1789126793.396555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675840 00000100:00100000:0.0:1789126793.396576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676352 00000100:00100000:0.0:1789126793.396579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676352 00000100:00100000:0.0:1789126793.396607:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126793.396618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276676224:12345-0@lo:400: 00000100:00100000:0.0:1789126793.396736:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276676224:12345-0@lo:400: Request processed in 119us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.396744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126793.396762:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789126793.396769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276675840:12345-0@lo:400: 00000100:00100000:0.0:1789126793.396799:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276675840:12345-0@lo:400: Request processed in 31us (5412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.396817:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789126793.396829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126793.396835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276676352:12345-0@lo:400: 00000100:00100000:0.0:1789126793.396861:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276676352:12345-0@lo:400: Request processed in 27us (5438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.396867:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126793.396905:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276676096:0@lo:400: 00000100:00100000:0.0:1789126793.396942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.396981:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276676608:0@lo:400: 00000100:00100000:0.0:1789126793.397017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.397045:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789126793.397051:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276675968:0@lo:400: 00000100:00100000:0.0:1789126793.397086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.397109:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276676480:0@lo:400: 00000100:00100000:0.0:1789126793.397145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126793.397175:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276675968 00000100:00100000:0.0:1789126793.397179:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276675968 00000100:00100000:0.0:1789126793.397204:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126793.397210:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276675968:12345-0@lo:400: 00000100:00100000:0.0:1789126793.397242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276675968:12345-0@lo:400: Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.397248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126793.397263:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676480 00000100:00100000:0.0:1789126793.397266:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676480 00000100:00100000:0.0:1789126793.397294:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126793.397301:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276676480:12345-0@lo:400: 00000100:00100000:0.0:1789126793.397331:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276676480:12345-0@lo:400: Request processed in 31us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.397336:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789126793.397359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676096 00000100:00100000:0.0:1789126793.397363:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676096 00000100:00100000:0.0:1789126793.397382:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676608 00000100:00100000:0.0:1789126793.397384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676608 00000100:00100000:0.0:1789126793.397400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789126793.397406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276676096:12345-0@lo:400: 00000100:00100000:0.0:1789126793.397436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276676096:12345-0@lo:400: Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.397442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789126793.397454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789126793.397459:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276676608:12345-0@lo:400: 00000100:00100000:0.0:1789126793.397484:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276676608:12345-0@lo:400: Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.397496:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789126793.397520:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676864 00000100:00100000:0.0:1789126793.397524:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676864 00000100:00100000:0.0:1789126793.397548:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789126793.397554:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276676864:12345-0@lo:13: 00002000:00000024:0.0:1789126793.397572:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126793.397606:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276676864:12345-0@lo:13: Request processed in 52us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126793.397613:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789126793.397681:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276675968:0@lo:400: 00010000:00080000:0.0:1789126793.397696:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec1e00 x1876035276676480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397707:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276676480:0@lo:400: 00010000:00080000:0.0:1789126793.397716:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec12c0 x1876035276676096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397725:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276676096:0@lo:400: 00010000:00080000:0.0:1789126793.397734:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420a88cf00 x1876035276676608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397743:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276676608:0@lo:400: 00010000:00080000:0.0:1789126793.397778:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec1680 x1876035276675840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397787:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276675840:0@lo:400: 00010000:00080000:0.0:1789126793.397797:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec3480 x1876035276676352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397813:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276676352:0@lo:400: 00010000:00080000:0.0:1789126793.397825:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f9e70c0 x1876035276676864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397839:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276676864:0@lo:13: 00000100:00100000:0.0:1789126793.397850:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276675712:0@lo:400: 00010000:00080000:0.0:1789126793.397861:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec1a40 x1876035276676224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126793.397869:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276676224:0@lo:400: 00000100:00080000:3.0:1789126793.398206:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126793.398212:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126793.398215:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126793.398391:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789126793.398401:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276676736:12345-0@lo:400: 00000100:00100000:2.0:1789126793.398466:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276676736:12345-0@lo:400: Request processed in 67us (7135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126793.398473:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789126793.399987:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f9e6580 x1876035276676736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126793.400003:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276676736:0@lo:400: 00000001:02000400:3.0:1789126793.466442:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789126793.646035:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789126794.255619:0:9920:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126794.256444:0:9920:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789126794.411936:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276676992:0@lo:41: 00000100:00100000:0.0:1789126794.412030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126794.412197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276676992 00000100:00100000:0.0:1789126794.412206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276676992 00000100:00100000:0.0:1789126794.412256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789126794.412265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276676992:12345-0@lo:41: 00000004:00000024:0.0:1789126794.412296:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789126794.412341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276676992:12345-0@lo:41: Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126794.412348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789126794.412390:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276676992:0@lo:41: 00010000:00010000:2.0:1789126794.666769:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126795.693123:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789126795.948052:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789126795.948059:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994220b43000 from 39 10000000:01000000:1.0:1789126795.948064:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789126795.948105:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.948117:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.948127:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.948149:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677120:0@lo:101: 00000100:00100000:1.0:1789126795.948213:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.948326:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.948326:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677120 00000100:00100000:0.0:1789126795.948335:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677120 00000100:00100000:0.0:1789126795.948399:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789126795.948409:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276677120:12345-0@lo:101: 00010000:00010000:0.0:1789126795.948422:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126795.948436:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea879 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.948460:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea879 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.948471:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea879 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.948481:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031200, rc 0) 00000100:00100000:0.0:1789126795.948530:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677120:12345-0@lo:101: Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.948537:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789126795.949124:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677120:0@lo:101: 00010000:00010000:1.0:1789126795.949140:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.949150:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.949211:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677248:0@lo:501: 00000100:00100000:1.0:1789126795.949242:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.954589:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.954787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677248 00000100:00100000:0.0:1789126795.954796:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677248 00000100:00100000:0.0:1789126795.954913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789126795.954923:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677248:12345-0@lo:501: 00000100:00100000:0.0:1789126795.955105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677248:12345-0@lo:501: Request processed in 184us (5862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.955113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789126795.955194:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677248:0@lo:501: 00000100:00100000:1.0:1789126795.955244:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677376:0@lo:503: 00000100:00100000:1.0:1789126795.955294:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.955410:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.955446:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677376 00000100:00100000:2.0:1789126795.955451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677376 00000100:00100000:2.0:1789126795.955473:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789126795.955480:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677376:12345-0@lo:503: 00000100:00100000:2.0:1789126795.955600:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677376:12345-0@lo:503: Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.955607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789126795.955840:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677376:0@lo:503: 00000100:00100000:2.0:1789126795.956168:0:9972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9972:1876035276677504:0@lo:502: 00000100:00100000:2.0:1789126795.956209:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.956272:0:9972:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210dbfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.956305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677504 00000100:00100000:0.0:1789126795.956308:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677504 00000100:00100000:0.0:1789126795.956369:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789126795.956376:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9972:x1876035276677504:12345-0@lo:502: 00000100:00100000:0.0:1789126795.956457:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:9972:x1876035276677504:12345-0@lo:502: Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.956468:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789126795.956527:0:9972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9972:1876035276677504:0@lo:502: 00000100:00100000:2.0:1789126795.956562:0:9972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9972:1876035276677632:0@lo:502: 00000100:00100000:2.0:1789126795.956589:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.956686:0:9972:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210dbfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126795.956839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677632 00000100:00100000:3.0:1789126795.956849:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677632 00000100:00100000:3.0:1789126795.956870:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789126795.956876:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:9972:x1876035276677632:12345-0@lo:502: 00000100:00100000:3.0:1789126795.956950:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:9972:x1876035276677632:12345-0@lo:502: Request processed in 74us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.956957:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789126795.957030:0:9972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9972:1876035276677632:0@lo:502: 00000040:00080000:2.0:1789126795.957046:0:9972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789126795.957186:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789126795.957205:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126795.957215:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.957226:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126795.957235:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789126795.957238:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789126795.957241:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789126795.957264:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.957272:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.957281:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126795.957293:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677760:0@lo:101: 00000100:00100000:3.0:1789126795.957317:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.957338:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.957379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677760 00000100:00100000:2.0:1789126795.957383:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677760 00000100:00100000:2.0:1789126795.957400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789126795.957406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276677760:12345-0@lo:101: 00010000:00010000:2.0:1789126795.957415:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126795.957426:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea887 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.957445:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea887 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.957454:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea887 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.957463:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:2.0:1789126795.957498:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276677760:12345-0@lo:101: Request processed in 92us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.957505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789126795.957567:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677760:0@lo:101: 00010000:00010000:3.0:1789126795.957586:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.957595:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126795.957637:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677888:0@lo:501: 00000100:00100000:3.0:1789126795.957794:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.957812:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.957879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276677888 00000100:00100000:2.0:1789126795.957889:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276677888 00000100:00100000:2.0:1789126795.957909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789126795.957915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276677888:12345-0@lo:501: 00000100:00100000:2.0:1789126795.958011:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276677888:12345-0@lo:501: Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.958018:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789126795.958128:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276677888:0@lo:501: 00000100:00100000:3.0:1789126795.958152:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678016:0@lo:503: 00000100:00100000:3.0:1789126795.958185:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.958212:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.958272:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678016 00000100:00100000:2.0:1789126795.958276:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678016 00000100:00100000:2.0:1789126795.958302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789126795.958309:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276678016:12345-0@lo:503: 00000100:00100000:2.0:1789126795.958382:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276678016:12345-0@lo:503: Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.958389:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789126795.958453:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678016:0@lo:503: 00000100:00100000:3.0:1789126795.958912:0:9973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9973:1876035276678144:0@lo:502: 00000100:00100000:3.0:1789126795.958957:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.958984:0:9973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.959029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678144 00000100:00100000:2.0:1789126795.959034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678144 00000100:00100000:2.0:1789126795.959063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789126795.959069:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9973:x1876035276678144:12345-0@lo:502: 00000100:00100000:2.0:1789126795.959148:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9973:x1876035276678144:12345-0@lo:502: Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.959154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789126795.959260:0:9973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9973:1876035276678144:0@lo:502: 00000020:01000000:3.0:1789126795.959280:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126795.959288:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126795.959291:0:9973:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789126795.959296:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789126795.959297:0:9973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789126795.959312:0:9973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9973:1876035276678272:0@lo:502: 00000100:00100000:3.0:1789126795.959342:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.959365:0:9973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.959414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678272 00000100:00100000:2.0:1789126795.959419:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678272 00000100:00100000:2.0:1789126795.959476:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789126795.959482:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9973:x1876035276678272:12345-0@lo:502: 00000100:00100000:2.0:1789126795.959542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:9973:x1876035276678272:12345-0@lo:502: Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.959548:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789126795.959668:0:9973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9973:1876035276678272:0@lo:502: 00000020:01000000:3.0:1789126795.959685:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126795.959699:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126795.959701:0:9973:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789126795.959705:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789126795.959885:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789126795.959904:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789126795.959911:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.959920:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126795.959928:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789126795.959931:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99423d256000 from 39 10000000:01000000:0.0:1789126795.959933:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789126795.959965:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.959972:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.959981:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126795.959992:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678400:0@lo:101: 00000100:00100000:0.0:1789126795.960020:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.960049:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126795.960092:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678400 00000100:00100000:3.0:1789126795.960096:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678400 00000100:00100000:3.0:1789126795.960115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789126795.960121:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276678400:12345-0@lo:101: 00010000:00010000:3.0:1789126795.960129:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126795.960141:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea895 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.960160:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea895 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.960170:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea895 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.960178:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ec00, rc 0) 00000100:00100000:3.0:1789126795.960215:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276678400:12345-0@lo:101: Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.960222:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789126795.960284:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678400:0@lo:101: 00010000:00010000:0.0:1789126795.960296:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.960304:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126795.960355:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678528:0@lo:501: 00000100:00100000:0.0:1789126795.960379:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.960399:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126795.960445:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678528 00000100:00100000:3.0:1789126795.960449:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678528 00000100:00100000:3.0:1789126795.960466:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789126795.960471:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276678528:12345-0@lo:501: 00000100:00100000:3.0:1789126795.960565:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276678528:12345-0@lo:501: Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.960581:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789126795.960679:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678528:0@lo:501: 00000100:00100000:0.0:1789126795.960714:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678656:0@lo:503: 00000100:00100000:0.0:1789126795.960746:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.960761:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126795.960867:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678656 00000100:00100000:3.0:1789126795.960871:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678656 00000100:00100000:3.0:1789126795.960888:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789126795.960893:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276678656:12345-0@lo:503: 00000100:00100000:3.0:1789126795.960973:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276678656:12345-0@lo:503: Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.960979:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789126795.961924:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276678656:0@lo:503: 00000100:00100000:0.0:1789126795.962580:0:9974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9974:1876035276678784:0@lo:502: 00000100:00100000:0.0:1789126795.962634:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.962790:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678784 00000100:00100000:3.0:1789126795.962795:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678784 00000100:00100000:3.0:1789126795.962822:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789126795.962830:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:9974:x1876035276678784:12345-0@lo:502: 00000100:00100000:3.0:1789126795.962921:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:9974:x1876035276678784:12345-0@lo:502: Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.962927:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789126795.962994:0:9974:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.963010:0:9974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9974:1876035276678784:0@lo:502: 00000100:00100000:0.0:1789126795.963047:0:9974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9974:1876035276678912:0@lo:502: 00000100:00100000:0.0:1789126795.963079:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.963100:0:9974:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126795.963152:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276678912 00000100:00100000:3.0:1789126795.963155:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276678912 00000100:00100000:3.0:1789126795.963173:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789126795.963178:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:9974:x1876035276678912:12345-0@lo:502: 00000100:00100000:3.0:1789126795.963247:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:9974:x1876035276678912:12345-0@lo:502: Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.963254:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789126795.963896:0:9974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9974:1876035276678912:0@lo:502: 00000040:00080000:0.0:1789126795.963919:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789126795.964167:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789126795.964189:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126795.964199:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.964221:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126795.964230:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789126795.964232:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99423d256000 from 6 10000000:01000000:3.0:1789126795.964234:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789126795.964260:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.964267:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.964275:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126795.964286:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679040:0@lo:101: 00000100:00100000:3.0:1789126795.964319:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.964352:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.966282:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679040 00000100:00100000:0.0:1789126795.966293:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679040 00000100:00100000:0.0:1789126795.966514:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789126795.966525:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276679040:12345-0@lo:101: 00010000:00010000:0.0:1789126795.966542:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126795.966560:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030400/0xa840b4da666ea8aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea8a3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.966596:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030400/0xa840b4da666ea8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea8a3 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.966607:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030400/0xa840b4da666ea8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8a3 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126795.966616:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030400, rc 0) 00000100:00100000:0.0:1789126795.966707:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276679040:12345-0@lo:101: Request processed in 184us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.966719:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789126795.967139:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679040:0@lo:101: 00010000:00010000:2.0:1789126795.967158:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.967169:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126795.967230:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679168:0@lo:256: 00000100:00100000:2.0:1789126795.967271:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.967308:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994207e1d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.967405:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679168 00000100:00100000:0.0:1789126795.967410:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679168 00000100:00100000:0.0:1789126795.967433:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789126795.967439:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276679168:12345-0@lo:256: 20000000:01000000:0.0:1789126795.967453:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789126795.967470:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789126795.967473:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789126795.967553:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276679168:12345-0@lo:256: Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.967561:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789126795.967693:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679168:0@lo:256: 10000000:01000000:2.0:1789126795.967747:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789126795.967754:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.967763:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126795.967771:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789126795.967773:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789126795.967776:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789126795.967796:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.967803:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.967811:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126795.967834:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679296:0@lo:101: 00000100:00100000:2.0:1789126795.967860:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.967881:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.967984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679296 00000100:00100000:1.0:1789126795.967989:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679296 00000100:00100000:1.0:1789126795.968010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789126795.968016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276679296:12345-0@lo:101: 00010000:00010000:1.0:1789126795.968024:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126795.968034:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea8b1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.968050:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.968058:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.968065:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588800, rc 0) 00000100:00100000:1.0:1789126795.968103:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276679296:12345-0@lo:101: Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.968109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789126795.969021:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679296:0@lo:101: 00010000:00010000:2.0:1789126795.969037:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126795.969046:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126795.969104:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679424:0@lo:501: 00000100:00100000:2.0:1789126795.969138:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.969160:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.969272:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679424 00000100:00100000:1.0:1789126795.969276:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679424 00000100:00100000:1.0:1789126795.969305:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789126795.969311:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276679424:12345-0@lo:501: 00000100:00100000:1.0:1789126795.969417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276679424:12345-0@lo:501: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.969432:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789126795.969594:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679424:0@lo:501: 00000100:00100000:2.0:1789126795.969616:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679552:0@lo:503: 00000100:00100000:2.0:1789126795.969680:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.969695:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.969794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679552 00000100:00100000:1.0:1789126795.969798:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679552 00000100:00100000:1.0:1789126795.969826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789126795.969832:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276679552:12345-0@lo:503: 00000100:00100000:1.0:1789126795.969905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276679552:12345-0@lo:503: Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.969911:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789126795.970233:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276679552:0@lo:503: 00000100:00100000:0.0:1789126795.973797:0:9975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9975:1876035276679680:0@lo:502: 00000100:00100000:0.0:1789126795.973880:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.973966:0:9975:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.975622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679680 00000100:00100000:1.0:1789126795.975633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679680 00000100:00100000:1.0:1789126795.977384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789126795.977397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:9975:x1876035276679680:12345-0@lo:502: 00000100:00100000:1.0:1789126795.977573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:9975:x1876035276679680:12345-0@lo:502: Request processed in 179us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.977582:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789126795.977737:0:9975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9975:1876035276679680:0@lo:502: 00000020:01000000:2.0:1789126795.977770:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789126795.977777:0:9975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789126795.977785:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126795.977787:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789126795.977793:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789126795.977802:0:9975:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1789126795.977824:0:9975:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789126795.977827:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789126795.977841:0:9975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9942366b9a48) 00000020:00000080:2.0:1789126795.977864:0:9975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789126795.977869:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789126795.977980:0:9975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789126795.977987:0:9975:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789126795.977994:0:9975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ea8c6 00010000:00080000:2.0:1789126795.978021:0:9975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941032b6800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789126795.978230:0:9975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789126795.978337:0:9975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789126795.978347:0:9975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789126795.978493:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789126795.978589:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789126795.978739:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789126795.978826:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789126795.979470:0:9976:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126795.979476:0:9976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789126795.980131:0:9975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789126795.980142:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789126795.980178:0:9975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789126795.980200:0:9975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea8cd 00000100:00080000:1.0:1789126795.980210:0:9975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789126795.980215:0:9975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b6800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126795.980248:0:9975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423675f0c0 x1876035276679808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789126795.980276:0:9975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789126795.980328:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126795.980332:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126795.980334:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789126795.980344:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126795.980348:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126795.980350:0:9975:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789126795.980353:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789126795.980355:0:9975:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789126795.980380:0:9975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9975:1876035276679936:0@lo:502: 00000100:00100000:1.0:1789126795.980450:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.980482:0:9975:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.980626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104133c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276680448:0@lo:400: 00000100:00100000:0.0:1789126795.980678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980698:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276680960:0@lo:400: 00000100:00100000:0.0:1789126795.980732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980751:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789126795.980757:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276680064:0@lo:400: 00000100:00100000:0.0:1789126795.980781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980796:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276680576:0@lo:400: 00000100:00100000:0.0:1789126795.980817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980832:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276681088:0@lo:400: 00000100:00100000:0.0:1789126795.980851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980872:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104133840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276680192:0@lo:400: 00000100:00100000:0.0:1789126795.980895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980912:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104130f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276680704:0@lo:400: 00000100:00100000:0.0:1789126795.980932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980959:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276681216:0@lo:400: 00000100:00100000:0.0:1789126795.980979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.980991:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789126795.980995:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104130780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276680320:0@lo:400: 00000100:00100000:0.0:1789126795.981014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.981024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276680832:0@lo:400: 00000100:00100000:0.0:1789126795.981042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.981071:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680448 00000100:00100000:0.0:1789126795.981077:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680448 00000100:00100000:0.0:1789126795.981106:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680192 00000100:00100000:0.0:1789126795.981109:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680192 00000100:00100000:0.0:1789126795.981122:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789126795.981129:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276680448:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981179:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276680448:12345-0@lo:400: Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981193:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789126795.981207:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789126795.981213:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276680192:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981245:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276680192:12345-0@lo:400: Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981251:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789126795.981266:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680960 00000100:00100000:0.0:1789126795.981269:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680960 00000100:00100000:0.0:1789126795.981296:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680832 00000100:00100000:0.0:1789126795.981299:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680832 00000100:00100000:0.0:1789126795.981316:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789126795.981323:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276680960:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981350:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276680960:12345-0@lo:400: Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981355:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789126795.981366:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789126795.981372:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276680832:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981394:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276680832:12345-0@lo:400: Request processed in 22us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981399:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789126795.981413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680064 00000100:00100000:0.0:1789126795.981415:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680064 00000100:00100000:0.0:1789126795.981430:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680576 00000100:00100000:0.0:1789126795.981431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680576 00000100:00100000:0.0:1789126795.981441:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681088 00000100:00100000:0.0:1789126795.981443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681088 00000100:00100000:0.0:1789126795.981452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680704 00000100:00100000:0.0:1789126795.981454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680704 00000100:00100000:0.0:1789126795.981474:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681216 00000100:00100000:0.0:1789126795.981477:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681216 00000100:00100000:0.0:1789126795.981487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276680320 00000100:00100000:0.0:1789126795.981489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276680320 00000100:00100000:0.0:1789126795.981499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789126795.981505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276680064:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981530:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276680064:12345-0@lo:400: Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981534:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789126795.981543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789126795.981549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276680576:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276680576:12345-0@lo:400: Request processed in 21us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789126795.981584:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789126795.981590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276681088:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276681088:12345-0@lo:400: Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981619:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789126795.981629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789126795.981633:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276680704:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981673:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276680704:12345-0@lo:400: Request processed in 40us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789126795.981689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789126795.981694:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276681216:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981717:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276681216:12345-0@lo:400: Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789126795.981741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789126795.981746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276680320:12345-0@lo:400: 00000100:00100000:0.0:1789126795.981773:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276680320:12345-0@lo:400: Request processed in 27us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.981779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789126795.981828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104130780 x1876035276680320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981842:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104130780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276680320:0@lo:400: 00010000:00080000:0.0:1789126795.981852:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104132d00 x1876035276680832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981860:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276680832:0@lo:400: 00000100:00100000:0.0:1789126795.981869:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104133840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276680192:0@lo:400: 00010000:00080000:0.0:1789126795.981877:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104130f00 x1876035276680704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981884:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104130f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276680704:0@lo:400: 00010000:00080000:0.0:1789126795.981892:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041312c0 x1876035276681216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276681216:0@lo:400: 00010000:00080000:0.0:1789126795.981932:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104132580 x1876035276680064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981950:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276680064:0@lo:400: 00010000:00080000:0.0:1789126795.981971:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041303c0 x1876035276680576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981978:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276680576:0@lo:400: 00010000:00080000:0.0:1789126795.981987:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041330c0 x1876035276681088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.981994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276681088:0@lo:400: 00000100:00100000:0.0:1789126795.982001:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104133c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276680448:0@lo:400: 00010000:00080000:0.0:1789126795.982008:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104131680 x1876035276680960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126795.982015:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276680960:0@lo:400: 00000100:00100000:3.0:1789126795.982111:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276679808:0@lo:8: 00000100:00100000:3.0:1789126795.982157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789126795.982198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126795.982202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126795.982205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126795.982224:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679936 00000100:00100000:3.0:1789126795.982228:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679936 00000100:00100000:3.0:1789126795.982260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789126795.982267:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:9975:x1876035276679936:12345-0@lo:502: 00000100:00100000:3.0:1789126795.982377:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:9975:x1876035276679936:12345-0@lo:502: Request processed in 110us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126795.982384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789126795.982482:0:9975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9975:1876035276679936:0@lo:502: 00000020:01000000:1.0:1789126795.982509:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126795.982516:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126795.982518:0:9975:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789126795.982522:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789126795.982689:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789126795.982710:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789126795.982719:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.982729:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126795.982738:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789126795.982741:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994212236800 from 39 10000000:01000000:3.0:1789126795.982743:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789126795.982769:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.982776:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126795.982785:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126795.982800:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681344:0@lo:101: 00000100:00100000:3.0:1789126795.982829:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126795.982849:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126795.983073:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276679808 00000100:00100000:0.0:1789126795.983078:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276679808 00000100:00100000:0.0:1789126795.983107:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789126795.983113:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1876035276679808:12345-0@lo:8: 00010000:00080000:0.0:1789126795.983137:0:8906:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1789126795.983162:0:8906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ea8db 00002000:00100000:0.0:1789126795.983174:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99410407d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789126795.983178:0:8906:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789126795.983181:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789126795.983232:0:8906:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789126795.983447:0:8906:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789126795.983468:0:8906:0:(import.c:65:import_set_state_nolock()) ffff99410407a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789126795.983515:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276679808:12345-0@lo:8: Request processed in 401us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.983530:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789126795.983603:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681344 00000100:00100000:1.0:1789126795.983608:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681344 00000100:00100000:1.0:1789126795.983644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789126795.983671:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276681344:12345-0@lo:101: 00010000:00010000:1.0:1789126795.983680:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126795.983692:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea8d4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.983713:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.983723:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.983731:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589600, rc 0) 00000100:00100000:1.0:1789126795.983761:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681344:12345-0@lo:101: Request processed in 92us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.983776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789126795.983812:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681344:0@lo:101: 00010000:00010000:1.0:1789126795.983825:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.983834:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.983886:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681472:0@lo:501: 00000100:00100000:1.0:1789126795.983910:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.983931:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.983955:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681472 00000100:00100000:1.0:1789126795.983958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681472 00000100:00100000:1.0:1789126795.983980:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789126795.983986:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681472:12345-0@lo:501: 00000100:00100000:1.0:1789126795.984079:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681472:12345-0@lo:501: Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.984086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789126795.984114:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681472:0@lo:501: 00000100:00100000:1.0:1789126795.984136:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681600:0@lo:503: 00000100:00100000:1.0:1789126795.984169:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.984182:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.984193:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681600 00000100:00100000:1.0:1789126795.984196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681600 00000100:00100000:1.0:1789126795.984215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789126795.984220:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681600:12345-0@lo:503: 00000100:00100000:1.0:1789126795.984293:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681600:12345-0@lo:503: Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.984300:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789126795.984338:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681600:0@lo:503: 00000100:00100000:1.0:1789126795.984505:0:9978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9978:1876035276681728:0@lo:502: 00000100:00100000:1.0:1789126795.984537:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.984556:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681728 00000100:00100000:1.0:1789126795.984559:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681728 00000100:00100000:1.0:1789126795.984579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789126795.984584:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:9978:x1876035276681728:12345-0@lo:502: 00000100:00100000:1.0:1789126795.984680:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:9978:x1876035276681728:12345-0@lo:502: Request processed in 94us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.984687:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789126795.984716:0:9978:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.984728:0:9978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9978:1876035276681728:0@lo:502: 00000100:00100000:1.0:1789126795.984764:0:9978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9978:1876035276681856:0@lo:502: 00000100:00100000:1.0:1789126795.984795:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.984812:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681856 00000100:00100000:1.0:1789126795.984815:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681856 00000100:00100000:1.0:1789126795.984835:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789126795.984841:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:9978:x1876035276681856:12345-0@lo:502: 00000100:00100000:1.0:1789126795.984895:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:9978:x1876035276681856:12345-0@lo:502: Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.984901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789126795.984928:0:9978:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.984956:0:9978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9978:1876035276681856:0@lo:502: 00000040:00080000:1.0:1789126795.984973:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789126795.985011:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789126795.985027:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789126795.985034:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985042:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126795.985050:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789126795.985052:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994212236800 from 6 10000000:01000000:1.0:1789126795.985054:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789126795.985072:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985079:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985087:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.985099:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681984:0@lo:101: 00000100:00100000:1.0:1789126795.985122:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.985134:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.985145:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276681984 00000100:00100000:1.0:1789126795.985148:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276681984 00000100:00100000:1.0:1789126795.985167:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789126795.985172:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276681984:12345-0@lo:101: 00010000:00010000:1.0:1789126795.985179:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126795.985194:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588c00/0xa840b4da666ea8f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea8e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985210:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588c00/0xa840b4da666ea8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea8e9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985219:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588c00/0xa840b4da666ea8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8e9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985226:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588c00, rc 0) 00000100:00100000:1.0:1789126795.985250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276681984:12345-0@lo:101: Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.985255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789126795.985278:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276681984:0@lo:101: 00010000:00010000:1.0:1789126795.985287:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985294:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.985328:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682112:0@lo:256: 00000100:00100000:1.0:1789126795.985353:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.985363:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.985372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682112 00000100:00100000:1.0:1789126795.985374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682112 00000100:00100000:1.0:1789126795.985391:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789126795.985396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276682112:12345-0@lo:256: 20000000:01000000:1.0:1789126795.985407:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789126795.985420:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789126795.985427:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789126795.985486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276682112:12345-0@lo:256: Request processed in 89us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.985492:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789126795.985515:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682112:0@lo:256: 10000000:01000000:1.0:1789126795.985550:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789126795.985555:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985561:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126795.985567:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789126795.985568:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789126795.985570:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789126795.985583:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985590:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985597:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.985607:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682240:0@lo:101: 00000100:00100000:1.0:1789126795.985629:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.985639:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.985669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682240 00000100:00100000:1.0:1789126795.985673:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682240 00000100:00100000:1.0:1789126795.985691:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789126795.985703:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276682240:12345-0@lo:101: 00010000:00010000:1.0:1789126795.985709:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126795.985715:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea8f7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985727:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985735:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985741:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589a00, rc 0) 00000100:00100000:1.0:1789126795.985765:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276682240:12345-0@lo:101: Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.985770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789126795.985793:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682240:0@lo:101: 00010000:00010000:1.0:1789126795.985801:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126795.985807:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126795.985840:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682368:0@lo:501: 00000100:00100000:1.0:1789126795.985860:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.985871:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.985880:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682368 00000100:00100000:1.0:1789126795.985882:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682368 00000100:00100000:1.0:1789126795.985897:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789126795.985902:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276682368:12345-0@lo:501: 00000100:00100000:1.0:1789126795.985993:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276682368:12345-0@lo:501: Request processed in 91us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.986000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789126795.986024:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682368:0@lo:501: 00000100:00100000:1.0:1789126795.986045:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682496:0@lo:503: 00000100:00100000:1.0:1789126795.986077:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.986090:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.986100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682496 00000100:00100000:1.0:1789126795.986103:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682496 00000100:00100000:1.0:1789126795.986123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789126795.986128:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276682496:12345-0@lo:503: 00000100:00100000:1.0:1789126795.986194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276682496:12345-0@lo:503: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126795.986200:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789126795.986233:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276682496:0@lo:503: 00010000:00080000:3.0:1789126795.986509:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675f0c0 x1876035276679808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789126805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126795.986519:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789126795.986533:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789126795.986540:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789126795.986546:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789126795.986549:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789126795.986570:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789126795.986576:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276679808:0@lo:8: 00000004:00080000:3.0:1789126795.986597:0:9976:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789126795.986676:0:9976:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 221191026575ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789126795.986682:0:9976:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789126795.987601:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9979:1876035276682624:0@lo:502: 00000100:00100000:0.0:1789126795.987680:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.987710:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126795.987866:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682624 00000100:00100000:2.0:1789126795.987872:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682624 00000100:00100000:2.0:1789126795.987911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789126795.987919:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:9979:x1876035276682624:12345-0@lo:502: 00000100:00100000:2.0:1789126795.988021:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:9979:x1876035276682624:12345-0@lo:502: Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126795.988028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789126795.988590:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9979:1876035276682624:0@lo:502: 00000020:01000000:0.0:1789126795.988619:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789126795.988626:0:9979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789126795.988632:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126795.988634:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789126795.988638:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789126795.988641:0:9979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:0.0:1789126795.988727:0:9979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789126795.988730:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789126795.988744:0:9979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff994103ecb490) 00000020:00000080:0.0:1789126795.988766:0:9979:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1789126795.988771:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789126795.988852:0:9979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789126795.988858:0:9979:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789126795.988864:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ea90c 00010000:00080000:0.0:1789126795.988892:0:9979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941041ab000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789126795.989126:0:9979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1789126795.989250:0:9979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789126795.989260:0:9979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789126795.989412:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126795.989518:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789126795.989667:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789126795.989785:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789126795.990755:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126795.990760:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1789126795.991126:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789126795.991741:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276682752:0@lo:700: 00000100:00100000:1.0:1789126795.991807:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.991845:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682752 00000100:00100000:1.0:1789126795.991850:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682752 00000100:00100000:1.0:1789126795.991950:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789126795.991961:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9977:x1876035276682752:12345-0@lo:700: 00000100:00100000:1.0:1789126795.991994:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876035276682880:0@lo:700: 00000100:00100000:1.0:1789126795.992022:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126795.992038:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d1336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126795.992053:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d133c00 going to sleep for 11 seconds 00000100:00080000:3.0:1789126795.992348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126795.992360:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276682880 00000100:00100000:3.0:1789126795.992364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276682880 00000100:00100000:3.0:1789126795.992400:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789126795.992407:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876035276682880:12345-0@lo:700: 40000000:02000000:3.0:1789126795.995602:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:00000080:0.0:1789126795.999377:0:9979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789126795.999392:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789126795.999440:0:9979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789126795.999465:0:9979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea913 00000100:00080000:0.0:1789126795.999475:0:9979:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789126795.999481:0:9979:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9941041ab000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126795.999513:0:9979:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994103ec1680 x1876035276683008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789126795.999533:0:9979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789126795.999593:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126795.999597:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126795.999599:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789126795.999602:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126795.999606:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126795.999607:0:9979:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789126795.999610:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789126795.999612:0:9979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789126795.999637:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9979:1876035276683136:0@lo:502: 00000100:00100000:2.0:1789126795.999705:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276683008:0@lo:8: 00000100:00100000:0.0:1789126795.999736:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126795.999746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126795.999768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683136 00000100:00100000:0.0:1789126795.999773:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683136 00000100:00100000:0.0:1789126795.999804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789126795.999812:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:9979:x1876035276683136:12345-0@lo:502: 00000100:00100000:0.0:1789126795.999920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:9979:x1876035276683136:12345-0@lo:502: Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126795.999928:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789126795.999979:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683008 00000100:00100000:0.0:1789126795.999983:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683008 00000100:00100000:0.0:1789126796.000012:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126796.000017:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276683008:12345-0@lo:8: 00010000:00080000:0.0:1789126796.000041:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1789126796.000066:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ea91a 00002000:00100000:0.0:1789126796.000078:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9941041ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789126796.000082:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789126796.000085:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789126796.000141:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789126796.000162:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9941041af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789126796.000207:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276683008:12345-0@lo:8: Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126796.000213:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789126796.000230:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126796.000247:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:9979:1876035276683136:0@lo:502: 00010000:00080000:2.0:1789126796.000268:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec1680 x1876035276683008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789126805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:0.0:1789126796.000269:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126796.000273:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126796.000275:0:9979:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000100:00100000:2.0:1789126796.000278:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000040:00080000:0.0:1789126796.000278:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00080000:2.0:1789126796.000290:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789126796.000296:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789126796.000300:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789126796.000302:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941041ab000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789126796.000315:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789126796.000320:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276683008:0@lo:8: 00000020:01000000:0.0:1789126796.000330:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1789126796.000350:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789126796.000359:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126796.000369:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126796.000379:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789126796.000381:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f0000 from 1 10000000:01000000:0.0:1789126796.000384:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789126796.000406:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126796.000424:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126796.000433:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126796.000444:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276683264:0@lo:101: 00000100:00100000:0.0:1789126796.000471:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.000493:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a700c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789126796.000764:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789126796.000803:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683264 00000004:00080000:0.0:1789126796.000806:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221205157124ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789126796.000807:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683264 00080000:00080000:0.0:1789126796.000812:0:9980:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789126796.000840:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789126796.000847:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276683264:12345-0@lo:101: 00010000:00010000:2.0:1789126796.000856:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126796.000869:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea921 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126796.000888:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea921 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126796.000897:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea921 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126796.000905:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3000, rc 0) 00000100:00100000:2.0:1789126796.000950:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276683264:12345-0@lo:101: Request processed in 103us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126796.000956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789126796.001053:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276683264:0@lo:101: 00010000:00010000:0.0:1789126796.001066:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126796.001074:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126796.001118:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276683392:0@lo:501: 00000100:00100000:0.0:1789126796.001143:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.001198:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126796.001330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683392 00000100:00100000:1.0:1789126796.001335:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683392 00000100:00100000:1.0:1789126796.001366:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789126796.001374:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276683392:12345-0@lo:501: 00000100:00100000:1.0:1789126796.001445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276683392:12345-0@lo:501: Request processed in 72us (301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126796.001452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789126796.001512:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276683392:0@lo:501: 10000000:01000000:0.0:1789126796.001534:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789126796.001540:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126796.001561:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126796.003024:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876035276682880:12345-0@lo:700: Request processed in 10612us (10995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126796.003036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789126796.003275:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675de00 x1876035276682880/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789126811 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126796.003288:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876035276682880:0@lo:700: 40000000:02000000:1.0:1789126796.003298:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:3.0:1789126796.006738:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789126796.006884:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789126796.006929:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683648:0@lo:7: 00000100:00100000:2.0:1789126796.007003:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126796.007027:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26840 going to sleep for 11 seconds 00000100:00100000:0.0:1789126796.007150:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126796.007163:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276683520:0@lo:13: 00000100:00100000:0.0:1789126796.007198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.007227:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683648 00000100:00100000:0.0:1789126796.007233:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683648 00000100:00100000:0.0:1789126796.007285:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789126796.007295:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9981:x1876035276683648:12345-0@lo:7: 00000100:00100000:2.0:1789126796.007987:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683520 00000100:00100000:2.0:1789126796.007992:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683520 00000100:00100000:2.0:1789126796.008023:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789126796.008030:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276683520:12345-0@lo:13: 00002000:00000024:2.0:1789126796.008046:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:2.0:1789126796.008107:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276683520:12345-0@lo:13: Request processed in 76us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126796.008114:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789126796.008187:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789126796.010574:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e580 x1876035276683520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126796.010598:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276683520:0@lo:13: 00000001:00100000:2.0:1789126796.012977:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789126796.012989:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789126796.014278:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9977:x1876035276682752:12345-0@lo:700: Request processed in 22314us (22464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126796.014293:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789126796.015295:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675f480 x1876035276682752/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789126811 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126796.015311:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276682752:0@lo:700: 00002000:00080000:1.0:1789126796.015814:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789126796.015821:0:8906:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789126796.016023:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1876035276683648:12345-0@lo:7: Request processed in 8727us (9016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126796.016034:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789126796.016292:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df480 x1876035276683648/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126796.016305:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683648:0@lo:7: 00000004:00080000:2.0:1789126796.016315:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789126796.016351:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683776:0@lo:5: 00000100:00100000:2.0:1789126796.016386:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.018014:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683776 00000100:00100000:0.0:1789126796.018023:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683776 00000100:00100000:2.0:1789126796.018036:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26840 going to sleep for 11 seconds 00000100:00100000:0.0:1789126796.018076:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789126796.018086:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9981:x1876035276683776:12345-0@lo:5: 00002000:00080000:0.0:1789126796.018114:0:8429:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789126796.018118:0:8429:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789126796.018502:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9981:x1876035276683776:12345-0@lo:5: Request processed in 417us (2115us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789126796.018509:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789126796.019209:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df480 x1876035276683776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126796.019225:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683776:0@lo:5: 00000004:00080000:2.0:1789126796.019237:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789126796.019346:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683904:0@lo:700: 00000100:00100000:3.0:1789126796.019407:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126796.020677:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0900 going to sleep for 11 seconds 00000004:00080000:3.0:1789126796.021126:0:9977:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789126796.021150:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684160:0@lo:7: 00000100:00100000:3.0:1789126796.021189:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.021211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276684032:0@lo:13: 00000100:00100000:3.0:1789126796.021214:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789126796.021246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126796.021291:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684160 00000100:00100000:0.0:1789126796.021298:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684160 00000100:00100000:3.0:1789126796.021338:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684032 00000100:00100000:3.0:1789126796.021342:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684032 00000100:00100000:0.0:1789126796.021354:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789126796.021362:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9977:x1876035276684160:12345-0@lo:7: 00000100:00100000:3.0:1789126796.021365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789126796.021369:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276684032:12345-0@lo:13: 00002000:00000024:3.0:1789126796.021382:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1789126796.021419:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276684032:12345-0@lo:13: Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126796.021425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789126796.021724:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276683904 00000100:00100000:1.0:1789126796.021729:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276683904 00000100:00100000:1.0:1789126796.021849:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789126796.021857:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9981:x1876035276683904:12345-0@lo:700: 00010000:00080000:0.0:1789126796.022893:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410401b480 x1876035276684032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126796.022913:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276684032:0@lo:13: 00000001:00080000:2.0:1789126796.024642:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789126796.025640:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9981:x1876035276683904:12345-0@lo:700: Request processed in 3780us (6229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126796.025728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789126796.025808:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647c000 x1876035276683904/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126796.025820:0:9981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789126796.025834:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276683904:0@lo:700: 00000004:02000040:3.0:1789126796.027138:0:9981:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:0.0:1789126796.028404:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789126796.028411:0:8430:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789126796.028621:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1876035276684160:12345-0@lo:7: Request processed in 7256us (7427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126796.028632:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789126796.031434:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104019e00 x1876035276684160/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126796.031453:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684160:0@lo:7: 00000004:00080000:1.0:1789126796.031468:0:9977:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789126796.031525:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684288:0@lo:5: 00000100:00100000:1.0:1789126796.031579:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126796.031627:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d133d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789126796.031721:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684288 00000100:00100000:0.0:1789126796.031728:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684288 00000100:00100000:0.0:1789126796.031773:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789126796.031782:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1876035276684288:12345-0@lo:5: 00002000:00080000:0.0:1789126796.031808:0:8428:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789126796.031853:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1876035276684288:12345-0@lo:5: Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126796.031860:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789126796.031902:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675de00 x1876035276684288/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126796.031912:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684288:0@lo:5: 00000004:00080000:1.0:1789126796.031921:0:9977:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789126796.031952:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684416:0@lo:5: 00000100:00100000:1.0:1789126796.031975:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126796.031997:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d133d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126796.032018:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684416 00000100:00100000:2.0:1789126796.032023:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684416 00000100:00100000:2.0:1789126796.032054:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789126796.032070:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9977:x1876035276684416:12345-0@lo:5: 00002000:00080000:2.0:1789126796.032095:0:8906:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789126796.036200:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9977:x1876035276684416:12345-0@lo:5: Request processed in 4130us (4215us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789126796.036215:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789126796.036300:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675de00 x1876035276684416/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126796.036318:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876035276684416:0@lo:5: 00000004:00080000:1.0:1789126796.036334:0:9977:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789126796.036380:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1876035276684544:0@lo:900: 00000100:00100000:1.0:1789126796.036418:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126796.036447:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d133d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126796.037604:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276684672:0@lo:5: 00000100:00100000:2.0:1789126796.037756:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684544 00000100:00100000:2.0:1789126796.037762:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684544 00000100:00100000:2.0:1789126796.037818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789126796.037827:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1876035276684544:12345-0@lo:900: 00000100:00100000:2.0:1789126796.037888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1876035276684544:12345-0@lo:900: Request processed in 62us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126796.037895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789126796.037967:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675f480 x1876035276684544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126796.037983:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1876035276684544:0@lo:900: 00000100:00100000:3.0:1789126796.038143:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126796.038171:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789126796.038219:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684672 00000100:00100000:1.0:1789126796.038223:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684672 00000100:00100000:1.0:1789126796.038258:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789126796.038264:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9981:x1876035276684672:12345-0@lo:5: 00002000:00080000:1.0:1789126796.042797:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789126796.042816:0:8428:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1789126796.044834:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9981:x1876035276684672:12345-0@lo:5: Request processed in 6564us (6685us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789126796.044846:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789126796.044916:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410401a1c0 x1876035276684672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789126812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126796.044934:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876035276684672:0@lo:5: 00000004:00080000:3.0:1789126796.044957:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1789126796.074512:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1789126796.074530:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789126796.716207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789126796.767758:0:10031:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789126796.767953:0:10031:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789126797.492391:0:10079:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789126797.492407:0:10079:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789126797.738870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126797.863126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.868213:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258810496 00000100:00100000:2.0:1789126797.868238:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258810496 00000100:00100000:2.0:1789126797.868313:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:2.0:1789126797.868324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1876035258810496:12345-192.168.203.23@tcp:250: 00010000:00080000:2.0:1789126797.869538:0:6506:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c860d42f-307d-4b4b-a338-6aeff2da97ec@192.168.203.23@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1789126797.869588:0:6506:0:(genops.c:1385:class_connect()) connect: client c860d42f-307d-4b4b-a338-6aeff2da97ec, cookie 0xa840b4da666ea92f 00000100:00080000:2.0:1789126797.869806:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126797.869903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+5:2390:x1876035258810496:12345-192.168.203.23@tcp:250: Request processed in 1578us (6785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.869915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:0.0:1789126797.873779:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.873935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258810624 00000100:00100000:2.0:1789126797.873951:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258810624 00000100:00100000:2.0:1789126797.874038:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:2.0:1789126797.874052:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+5:6147:x1876035258810624:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1789126797.874075:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126797.874099:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c212 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.874137:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.874150:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.874161:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126797.874242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+6:6147:x1876035258810624:12345-192.168.203.23@tcp:101: Request processed in 194us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.874251:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:3.0:1789126797.879903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.879999:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258810752 00000100:00100000:2.0:1789126797.880009:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258810752 00000100:00100000:1.0:1789126797.880108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:1.0:1789126797.880191:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+6:6147:x1876035258810752:12345-192.168.203.23@tcp:501: 00000100:00100000:1.0:1789126797.880309:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+6:6147:x1876035258810752:12345-192.168.203.23@tcp:501: Request processed in 192us (412us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126797.880327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1789126797.887302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.887539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258810880 00000100:00100000:2.0:1789126797.887549:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258810880 00000100:00100000:2.0:1789126797.887695:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:2.0:1789126797.887716:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+6:6147:x1876035258810880:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1789126797.887733:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126797.887749:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c219 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.887782:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.887811:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.887819:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3800, rc 0) 00000100:00100000:2.0:1789126797.887869:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+7:6147:x1876035258810880:12345-192.168.203.23@tcp:101: Request processed in 166us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.887875:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:2.0:1789126797.890312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126797.890396:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811008 00000100:00100000:1.0:1789126797.890403:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811008 00000100:00100000:1.0:1789126797.890453:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:1.0:1789126797.890462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+7:6147:x1876035258811008:12345-192.168.203.23@tcp:501: 00000100:00100000:1.0:1789126797.890606:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6147:x1876035258811008:12345-192.168.203.23@tcp:501: Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126797.890615:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:3.0:1789126797.895031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.895230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811136 00000100:00100000:2.0:1789126797.895243:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811136 00000100:00100000:2.0:1789126797.895359:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:2.0:1789126797.895369:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6147:x1876035258811136:12345-192.168.203.23@tcp:503: 00000100:00100000:2.0:1789126797.895531:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6147:x1876035258811136:12345-192.168.203.23@tcp:503: Request processed in 163us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.895538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:2.0:1789126797.900154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126797.900332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811264 00000100:00100000:0.0:1789126797.900341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811264 00000100:00100000:0.0:1789126797.900392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:0.0:1789126797.900403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6165:x1876035258811264:12345-192.168.203.23@tcp:502: 00000100:00100000:0.0:1789126797.900559:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6165:x1876035258811264:12345-192.168.203.23@tcp:502: Request processed in 155us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126797.900575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:3.0:1789126797.936483:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.936608:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811392 00000100:00100000:2.0:1789126797.936620:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811392 00000100:00100000:2.0:1789126797.936727:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:2.0:1789126797.936738:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6165:x1876035258811392:12345-192.168.203.23@tcp:502: 00000100:00100000:2.0:1789126797.936950:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6165:x1876035258811392:12345-192.168.203.23@tcp:502: Request processed in 212us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.936959:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:3.0:1789126797.940832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126797.941076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811520 00000100:00100000:0.0:1789126797.941088:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811520 00000100:00100000:0.0:1789126797.941161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:0.0:1789126797.941173:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6147:x1876035258811520:12345-192.168.203.23@tcp:101: 00010000:00010000:0.0:1789126797.941194:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126797.941217:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030800/0xa840b4da666ea944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c24a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126797.941254:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030800/0xa840b4da666ea944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c24a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126797.941266:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030800/0xa840b4da666ea944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c24a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126797.941278:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030800, rc 0) 00000100:00100000:0.0:1789126797.941347:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6147:x1876035258811520:12345-192.168.203.23@tcp:101: Request processed in 176us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126797.941355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:0.0:1789126797.944744:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126797.947192:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811648 00000100:00100000:1.0:1789126797.947217:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811648 00000100:00100000:1.0:1789126797.947357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:1.0:1789126797.947370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6147:x1876035258811648:12345-192.168.203.23@tcp:256: 20000000:01000000:1.0:1789126797.947407:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789126797.947442:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789126797.947447:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789126797.947458:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789126797.947462:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789126797.947465:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789126797.951386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6147:x1876035258811648:12345-192.168.203.23@tcp:256: Request processed in 4001us (6724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126797.951406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:3.0:1789126797.957841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.957991:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811776 00000100:00100000:2.0:1789126797.958006:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811776 00000100:00100000:2.0:1789126797.958101:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:2.0:1789126797.958111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6147:x1876035258811776:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1789126797.958134:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126797.958157:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c251 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.958191:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.958204:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126797.958214:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2200, rc 0) 00000100:00100000:2.0:1789126797.958292:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6147:x1876035258811776:12345-192.168.203.23@tcp:101: Request processed in 181us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.958300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:2.0:1789126797.963128:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126797.965326:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258811904 00000100:00100000:1.0:1789126797.965346:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258811904 00000100:00100000:1.0:1789126797.965430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:1.0:1789126797.965443:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6147:x1876035258811904:12345-192.168.203.23@tcp:501: 00000100:00100000:1.0:1789126797.965713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6147:x1876035258811904:12345-192.168.203.23@tcp:501: Request processed in 271us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126797.965727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:3.0:1789126797.970568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126797.970906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812032 00000100:00100000:0.0:1789126797.970931:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812032 00000100:00100000:0.0:1789126797.971013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1789126797.971026:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6147:x1876035258812032:12345-192.168.203.23@tcp:503: 00000100:00100000:0.0:1789126797.972239:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6147:x1876035258812032:12345-192.168.203.23@tcp:503: Request processed in 1203us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126797.972252:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1789126797.978849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126797.979051:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812160 00000100:00100000:2.0:1789126797.979063:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812160 00000100:00100000:2.0:1789126797.979180:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:2.0:1789126797.979194:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6171:x1876035258812160:12345-192.168.203.23@tcp:502: 00000100:00100000:2.0:1789126797.979426:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6171:x1876035258812160:12345-192.168.203.23@tcp:502: Request processed in 234us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126797.979435:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:2.0:1789126797.982036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126797.982197:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812288 00000100:00100000:0.0:1789126797.982208:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812288 00000100:00100000:0.0:1789126797.982274:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:0.0:1789126797.982285:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6171:x1876035258812288:12345-192.168.203.23@tcp:502: 00000100:00100000:0.0:1789126797.982544:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6171:x1876035258812288:12345-192.168.203.23@tcp:502: Request processed in 259us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126797.982554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:3.0:1789126797.986563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126797.986621:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126797.986709:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812416 00000100:00100000:1.0:1789126797.986732:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812416 00000100:00100000:1.0:1789126797.986792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812672 00000100:00100000:1.0:1789126797.986795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812672 00000100:00100000:1.0:1789126797.986822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1789126797.986832:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1876035258812416:12345-192.168.203.23@tcp:38: 00010000:00080000:1.0:1789126797.986879:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1789126797.986965:0:6513:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666ea952 00000004:00100000:1.0:1789126797.986996:0:6513:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789126797.987064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1789126797.987072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1876035258812672:12345-192.168.203.23@tcp:38: 00010000:00080000:0.0:1789126797.987091:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1789126797.987135:0:6514:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666ea959 00000004:00100000:0.0:1789126797.987153:0:6514:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789126797.987340:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9941031e8000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789126797.987390:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9941041ae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126797.987436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258812416:12345-192.168.203.23@tcp:38: Request processed in 604us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126797.987578:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789126797.987604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258812672:12345-192.168.203.23@tcp:38: Request processed in 529us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126797.987612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789126797.995466:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276684800:0@lo:41: 00000100:00100000:2.0:1789126797.995566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126798.001422:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684800 00000100:00100000:3.0:1789126798.001443:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684800 00000100:00100000:3.0:1789126798.001526:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789126798.001539:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276684800:12345-0@lo:41: 00000004:00000024:3.0:1789126798.001590:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126798.001743:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276684800:12345-0@lo:41: Request processed in 206us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126798.001751:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789126798.002246:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276684800:0@lo:41: 00000100:00100000:0.0:1789126798.507066:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126798.507096:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276684928:0@lo:13: 00000100:00100000:0.0:1789126798.507200:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126798.507294:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276684928 00000100:00100000:3.0:1789126798.507306:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276684928 00000100:00100000:3.0:1789126798.507406:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789126798.507482:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276684928:12345-0@lo:13: 00002000:00000024:3.0:1789126798.507527:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789126798.507537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126798.507603:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276684928:12345-0@lo:13: Request processed in 187us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126798.507614:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789126798.507614:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126798.507630:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276685056:0@lo:13: 00010000:00080000:0.0:1789126798.507707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec30c0 x1876035276684928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126798.507731:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276684928:0@lo:13: 00000100:00100000:2.0:1789126798.507829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126798.508331:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685056 00000100:00100000:3.0:1789126798.508337:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685056 00000100:00100000:3.0:1789126798.508411:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789126798.508418:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276685056:12345-0@lo:13: 00002000:00000024:3.0:1789126798.508450:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126798.508498:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276685056:12345-0@lo:13: Request processed in 81us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126798.508505:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789126798.508576:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030dcb40 x1876035276685056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126798.508592:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276685056:0@lo:13: 00000100:00080000:0.0:1789126798.508632:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789126798.762832:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126798.991392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126798.991498:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126798.993127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812928 00000100:00100000:2.0:1789126798.993147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812928 00000100:00100000:3.0:1789126798.993189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126798.993309:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812800 00000100:00100000:1.0:1789126798.993333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812800 00000100:00100000:1.0:1789126798.993461:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258812544 00000100:00100000:1.0:1789126798.993465:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258812544 00000100:00080000:3.0:1789126798.993492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126798.993497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126798.997334:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1789126798.997386:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:0:x1876035258812800:12345-192.168.203.23@tcp:41: 00000004:00000024:0.0:1789126798.997442:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126798.997471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789126798.997486:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:0:x1876035258812544:12345-192.168.203.23@tcp:41: 00000004:00000024:2.0:1789126798.997513:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789126798.997583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:0:x1876035258812544:12345-192.168.203.23@tcp:41: Request processed in 102us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126798.997592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789126798.997616:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789126798.997624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258812928:12345-192.168.203.23@tcp:41: 00000004:00000024:2.0:1789126798.997637:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789126798.997675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258812928:12345-192.168.203.23@tcp:41: Request processed in 50us (6299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126798.997682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1789126798.997800:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:0:x1876035258812800:12345-192.168.203.23@tcp:41: Request processed in 427us (6299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126798.997809:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789126799.002349:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126799.002675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813056 00000100:00100000:0.0:1789126799.002688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813056 00000100:00100000:0.0:1789126799.002766:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1789126799.002778:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813056:12345-192.168.203.23@tcp:40: 00000100:00100000:0.0:1789126799.002882:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813056:12345-192.168.203.23@tcp:40: Request processed in 106us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126799.002891:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1789126799.009882:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126799.010003:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126799.010049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126799.010142:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813440 00000100:00100000:3.0:1789126799.010154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813440 00000100:00100000:3.0:1789126799.010231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789126799.010243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813440:12345-192.168.203.23@tcp:900: 00000100:00100000:3.0:1789126799.010363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813440:12345-192.168.203.23@tcp:900: Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126799.010371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1789126799.014565:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813184 00000100:00100000:0.0:1789126799.014582:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813184 00000100:00100000:1.0:1789126799.017197:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813312 00000100:00100000:1.0:1789126799.017221:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813312 00000100:00100000:0.0:1789126799.017239:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789126799.017256:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1876035258813184:12345-192.168.203.23@tcp:8: 00000100:00100000:1.0:1789126799.017292:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789126799.017301:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1876035258813312:12345-192.168.203.23@tcp:8: 00010000:00080000:0.0:1789126799.017339:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1789126799.017376:0:8430:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666ea960 00002000:00100000:0.0:1789126799.017387:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7cbe914d-2346-44a4-9fd5-22d31c7628a2/ffff994104078800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789126799.017396:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789126799.017715:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789126799.017754:0:8430:0:(import.c:65:import_set_state_nolock()) ffff99410407f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126799.017853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126799.017906:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126799.017961:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813568 00000100:00100000:3.0:1789126799.017968:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813568 00000100:00100000:2.0:1789126799.017984:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813696 00000100:00100000:2.0:1789126799.017988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813696 00000100:00100000:0.0:1789126799.018004:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258813184:12345-192.168.203.23@tcp:8: Request processed in 747us (8130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126799.018017:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789126799.018023:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:2.0:1789126799.018023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1789126799.018042:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813696:12345-192.168.203.23@tcp:33: 00000100:00100000:3.0:1789126799.018123:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258813568:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1789126799.018514:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258813568:12345-192.168.203.23@tcp:400: Request processed in 475us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126799.018524:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 195 00010000:00080000:1.0:1789126799.019748:0:8906:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1789126799.019851:0:8906:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666ea967 00002000:00100000:1.0:1789126799.019867:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7cbe914d-2346-44a4-9fd5-22d31c7628a2/ffff9941031ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789126799.019890:0:8906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789126799.020604:0:8906:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789126799.020674:0:8906:0:(import.c:65:import_set_state_nolock()) ffff9941031ec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126799.020994:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258813312:12345-192.168.203.23@tcp:8: Request processed in 3690us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126799.021008:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000004:00080000:0.0:1789126799.031503:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13342us 00000004:00200000:0.0:1789126799.040829:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789126799.041567:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6147:x1876035258813696:12345-192.168.203.23@tcp:33: Request processed in 23523us (23655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126799.041582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789126799.195064:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126799.195159:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813824 00000100:00100000:3.0:1789126799.195170:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813824 00000100:00100000:3.0:1789126799.195231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1789126799.195241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6190:x1876035258813824:12345-192.168.203.23@tcp:101: 00010000:00010000:3.0:1789126799.195273:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126799.195349:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ee00/0xa840b4da666ea96e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c282 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195483:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195496:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195511:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126799.195555:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126799.195558:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126799.195573:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195598:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ee00/0xa840b4da666ea96e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c282 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195618:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c282 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126799.195627:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261e500) 00010000:00010000:3.0:1789126799.195631:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126799.195635:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:2.0:1789126799.195929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:6190:x1876035258813824:12345-192.168.203.23@tcp:101: Request processed in 687us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126799.195937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1789126799.531226:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276685184:0@lo:41: 00000100:00100000:0.0:1789126799.531329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126799.532465:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685184 00000100:00100000:3.0:1789126799.532475:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685184 00000100:00100000:3.0:1789126799.532535:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789126799.532558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276685184:12345-0@lo:41: 00000004:00000024:3.0:1789126799.532587:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789126799.532688:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276685184:12345-0@lo:41: Request processed in 131us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126799.532696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789126799.532705:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276685184:0@lo:41: 00010000:00010000:3.0:1789126799.786866:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126800.810816:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126801.068366:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276685312:0@lo:13: 00000100:00100000:2.0:1789126801.068437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126801.068704:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126801.068714:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276685440:0@lo:13: 00000100:00100000:1.0:1789126801.068742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126801.068784:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685312 00000100:00100000:1.0:1789126801.068790:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685312 00000100:00100000:1.0:1789126801.068833:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685440 00000100:00100000:1.0:1789126801.068836:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685440 00000100:00100000:1.0:1789126801.068851:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789126801.068858:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276685312:12345-0@lo:13: 00002000:00000024:1.0:1789126801.068885:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126801.068946:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276685312:12345-0@lo:13: Request processed in 87us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.068968:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789126801.068994:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104131680 x1876035276685312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126801.068999:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789126801.069010:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789126801.069010:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276685440:12345-0@lo:13: 00002000:00000024:1.0:1789126801.069023:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126801.069036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276685312:0@lo:13: 00000100:00100000:1.0:1789126801.069058:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276685440:12345-0@lo:13: Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.069065:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789126801.069090:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675fc00 x1876035276685440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126801.069098:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789126801.069110:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276685440:0@lo:13: 00000100:00080000:0.0:1789126801.069229:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126801.069760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276685952:0@lo:400: 00000100:00100000:0.0:1789126801.069794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126801.069824:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276686464:0@lo:400: 00000100:00100000:0.0:1789126801.069847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126801.069863:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789126801.069868:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276685568:0@lo:400: 00000100:00100000:3.0:1789126801.069894:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686464 00000100:00100000:0.0:1789126801.069899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126801.069910:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686464 00000100:00100000:0.0:1789126801.069946:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686080:0@lo:400: 00000100:00100000:3.0:1789126801.069959:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789126801.069968:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276686464:12345-0@lo:400: 00000100:00100000:0.0:1789126801.069986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126801.070009:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686592:0@lo:400: 00000100:00100000:3.0:1789126801.070019:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276686464:12345-0@lo:400: Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126801.070026:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789126801.070036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789126801.070069:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e098000 x1876035276686464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126801.070079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276686464:0@lo:400: 00000100:00100000:0.0:1789126801.070100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686080 00000100:00100000:0.0:1789126801.070109:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686080 00000100:00100000:0.0:1789126801.070137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789126801.070143:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686080:12345-0@lo:400: 00000100:00100000:0.0:1789126801.070177:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686080:12345-0@lo:400: Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126801.070183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789126801.070206:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686080:0@lo:400: 00000100:00080000:0.0:1789126801.070220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126801.070274:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685568 00000100:00100000:1.0:1789126801.070277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685568 00000100:00100000:1.0:1789126801.070320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789126801.070328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276685568:12345-0@lo:400: 00000100:00100000:1.0:1789126801.070364:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276685568:12345-0@lo:400: Request processed in 38us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.070370:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789126801.070400:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276685568:0@lo:400: 00000100:00100000:1.0:1789126801.070433:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276685696:0@lo:400: 00000100:00100000:1.0:1789126801.070456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126801.070474:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276686208:0@lo:400: 00000100:00100000:1.0:1789126801.070493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126801.070521:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276686720:0@lo:400: 00000100:00100000:2.0:1789126801.070698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685952 00000100:00100000:2.0:1789126801.070702:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685952 00000100:00100000:2.0:1789126801.070735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685696 00000100:00100000:2.0:1789126801.070738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685696 00000100:00100000:2.0:1789126801.070750:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686208 00000100:00100000:2.0:1789126801.070752:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686208 00000100:00100000:2.0:1789126801.070777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126801.070783:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104133c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276685952:12345-0@lo:400: 00000100:00100000:2.0:1789126801.070821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104133c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276685952:12345-0@lo:400: Request processed in 39us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126801.070834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126801.070847:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126801.070853:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276685696:12345-0@lo:400: 00000100:00100000:2.0:1789126801.070878:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276685696:12345-0@lo:400: Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126801.070884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126801.070900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126801.070920:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276686208:12345-0@lo:400: 00000100:00100000:2.0:1789126801.070946:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276686208:12345-0@lo:400: Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126801.070951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126801.070992:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276685824:0@lo:400: 00000100:00100000:2.0:1789126801.071016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126801.071032:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276686336:0@lo:400: 00000100:00100000:2.0:1789126801.071053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126801.071065:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276686848:0@lo:400: 00000100:00100000:2.0:1789126801.071099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126801.071123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686336 00000100:00100000:2.0:1789126801.071126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686336 00000100:00100000:2.0:1789126801.071142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686848 00000100:00100000:2.0:1789126801.071144:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686848 00000100:00100000:2.0:1789126801.071156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789126801.071162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276686336:12345-0@lo:400: 00000100:00100000:2.0:1789126801.071194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276686336:12345-0@lo:400: Request processed in 32us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126801.071200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789126801.071212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789126801.071218:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276686848:12345-0@lo:400: 00000100:00100000:2.0:1789126801.071244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276686848:12345-0@lo:400: Request processed in 27us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126801.071251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789126801.071276:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df480 x1876035276686336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126801.071292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276686336:0@lo:400: 00010000:00080000:2.0:1789126801.071304:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e09a940 x1876035276686848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126801.071311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276686848:0@lo:400: 00000100:00100000:1.0:1789126801.071630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126801.071683:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276685696:0@lo:400: 00000100:00100000:1.0:1789126801.071694:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276686208:0@lo:400: 00000100:00100000:1.0:1789126801.071721:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276685952:0@lo:400: 00000100:00100000:1.0:1789126801.071736:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686720 00000100:00100000:1.0:1789126801.071739:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686720 00000100:00100000:1.0:1789126801.071764:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789126801.071771:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276686720:12345-0@lo:400: 00000100:00100000:1.0:1789126801.071807:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276686720:12345-0@lo:400: Request processed in 37us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.071814:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789126801.071840:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276686720:0@lo:400: 00000100:00080000:1.0:1789126801.071870:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126801.071874:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126801.071889:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276685824 00000100:00100000:1.0:1789126801.071892:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276685824 00000100:00100000:3.0:1789126801.071928:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686592 00000100:00100000:3.0:1789126801.071934:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686592 00000100:00100000:1.0:1789126801.071935:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789126801.071946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276685824:12345-0@lo:400: 00000100:00100000:3.0:1789126801.071975:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789126801.071984:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686592:12345-0@lo:400: 00000100:00100000:1.0:1789126801.072003:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276685824:12345-0@lo:400: Request processed in 58us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.072010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789126801.072037:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686592:12345-0@lo:400: Request processed in 53us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.072044:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276685824:0@lo:400: 00000100:00100000:3.0:1789126801.072046:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789126801.072091:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e09a1c0 x1876035276686592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126801.072103:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686592:0@lo:400: 00000100:00080000:3.0:1789126801.072130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126801.072134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126801.072157:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258813952 00000100:00100000:1.0:1789126801.072161:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258813952 00000100:00100000:1.0:1789126801.072196:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1789126801.072203:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:6242:x1876035258813952:12345-192.168.203.23@tcp:41: 00000004:00000024:1.0:1789126801.072225:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789126801.072266:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:6242:x1876035258813952:12345-192.168.203.23@tcp:41: Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.072273:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00080000:3.0:1789126801.072801:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126801.074684:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126801.075825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814080 00000100:00100000:1.0:1789126801.075839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814080 00000100:00100000:1.0:1789126801.075955:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789126801.076245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814080:12345-192.168.203.23@tcp:41: 00000004:00000024:1.0:1789126801.076282:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789126801.076356:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814080:12345-192.168.203.23@tcp:41: Request processed in 116us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126801.076365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00080000:3.0:1789126801.076898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126801.079960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126801.080200:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814208 00000100:00100000:3.0:1789126801.080214:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814208 00000100:00100000:3.0:1789126801.080354:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1789126801.080367:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814208:12345-192.168.203.23@tcp:13: 00002000:00000024:3.0:1789126801.080414:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126801.080509:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814208:12345-192.168.203.23@tcp:13: Request processed in 144us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126801.080518:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00080000:1.0:1789126801.080974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126801.083691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126801.084215:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814336 00000100:00100000:3.0:1789126801.084228:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814336 00000100:00100000:3.0:1789126801.084362:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789126801.084375:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814336:12345-192.168.203.23@tcp:13: 00002000:00000024:3.0:1789126801.084440:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126801.084535:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:6242:x1876035258814336:12345-192.168.203.23@tcp:13: Request processed in 162us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126801.084544:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00080000:1.0:1789126801.085870:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789126801.834939:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126802.858765:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126803.114908:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686976:0@lo:41: 00000100:00100000:0.0:1789126803.114981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126803.115107:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276686976 00000100:00100000:3.0:1789126803.115116:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276686976 00000100:00100000:3.0:1789126803.115173:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789126803.115183:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686976:12345-0@lo:41: 00000004:00000024:3.0:1789126803.115216:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126803.115274:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276686976:12345-0@lo:41: Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126803.115292:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789126803.115458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276686976:0@lo:41: 00000001:02000400:1.0:1789126803.118782:0:10177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789126803.626968:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126803.626993:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276687104:0@lo:13: 00000100:00100000:3.0:1789126803.627069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126803.627097:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276687104 00000100:00100000:2.0:1789126803.627106:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276687104 00000100:00080000:1.0:1789126803.627144:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126803.627164:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789126803.627177:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276687104:12345-0@lo:13: 00002000:00000024:2.0:1789126803.627203:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126803.627256:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276687104:12345-0@lo:13: Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126803.627263:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789126803.627346:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410401b0c0 x1876035276687104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126803.627365:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276687104:0@lo:13: 00000100:00100000:3.0:1789126803.627846:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126803.627857:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276687232:0@lo:13: 00000100:00100000:3.0:1789126803.627900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126803.627957:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276687232 00000100:00100000:3.0:1789126803.627961:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276687232 00000100:00100000:3.0:1789126803.627990:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789126803.627997:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276687232:12345-0@lo:13: 00002000:00000024:3.0:1789126803.628009:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126803.628037:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276687232:12345-0@lo:13: Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126803.628042:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789126803.628066:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410401b0c0 x1876035276687232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126803.628078:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276687232:0@lo:13: 00000100:00080000:0.0:1789126803.628282:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789126803.629792:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000001:00100000:0.0:1789126803.630196:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000001:00100000:3.0:1789126803.632578:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00010000:00010000:3.0:1789126803.882805:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126804.306024:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126804.306064:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126804.306094:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126804.306112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126804.306144:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126804.306196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814464 00000100:00100000:3.0:1789126804.306205:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814464 00000100:00100000:3.0:1789126804.306259:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:3.0:1789126804.306274:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258814464:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1789126804.306337:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258814464:12345-192.168.203.23@tcp:400: Request processed in 65us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126804.306345:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:3.0:1789126804.306378:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814976 00000100:00100000:3.0:1789126804.306382:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814976 00000100:00100000:3.0:1789126804.306418:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814848 00000100:00100000:3.0:1789126804.306421:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814848 00000100:00100000:3.0:1789126804.306443:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789126804.306450:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e0983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258814976:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1789126804.306476:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e0983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258814976:12345-192.168.203.23@tcp:400: Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126804.306482:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789126804.306492:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789126804.306498:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258814848:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1789126804.306517:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258814848:12345-192.168.203.23@tcp:400: Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126804.306523:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1789126804.306631:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814720 00000100:00100000:1.0:1789126804.306637:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814720 00000100:00080000:3.0:1789126804.306689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126804.306693:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258814592 00000100:00080000:3.0:1789126804.306695:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126804.306697:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258814592 00000100:00080000:3.0:1789126804.306699:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126804.306718:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126804.306733:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1789126804.306742:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258814720:12345-192.168.203.23@tcp:400: 00000100:00100000:1.0:1789126804.306868:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258814720:12345-192.168.203.23@tcp:400: Request processed in 126us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126804.306897:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1789126804.306917:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1789126804.306925:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258814592:12345-192.168.203.23@tcp:400: 00000100:00100000:1.0:1789126804.306953:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258814592:12345-192.168.203.23@tcp:400: Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126804.306960:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1789126804.659193:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276687360:0@lo:41: 00000100:00100000:3.0:1789126804.659257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126804.659345:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276687360 00000100:00100000:3.0:1789126804.659352:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276687360 00000100:00100000:3.0:1789126804.659400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789126804.659408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276687360:12345-0@lo:41: 00000004:00000024:3.0:1789126804.659439:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789126804.659478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276687360:12345-0@lo:41: Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126804.659485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789126804.659529:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276687360:0@lo:41: 00000001:00100000:0.0:1789126804.660688:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00010000:00010000:0.0:1789126804.911110:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.934144:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789126805.965400:0:10325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeead77520 20000000:00000080:1.0:1789126805.965417:0:10325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99423d1a2000 uarg=0000000000000000 20000000:01000000:1.0:1789126805.965466:0:10325:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789126805.965469:0:10325:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789126805.965472:0:10325:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789126805.965477:0:10325:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789126805.965481:0:10325:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789126805.965541:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789126805.965544:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789126805.967411:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789126805.967695:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789126805.967843:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789126805.967862:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789126805.967885:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789126805.967888:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789126805.969519:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789126805.969781:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789126805.969815:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789126805.969830:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789126805.969841:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789126805.969843:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789126805.970370:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789126805.970785:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789126805.970815:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789126805.970831:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789126805.970840:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789126805.970842:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789126805.972952:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789126805.975758:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789126805.975796:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789126805.975814:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789126805.975826:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789126805.975828:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789126805.979796:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789126805.980880:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789126805.980915:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789126805.980933:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1789126805.980946:0:10325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789126805.980965:0:10325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981000:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea810 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981009:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea83a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981016:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea879 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981023:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea887 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981030:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea895 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981037:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981043:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981050:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981056:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea921 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981067:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981085:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981092:0:10325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981130:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981144:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 9 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981158:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687488:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126805.981253:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981261:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981269:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687616:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126805.981301:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981310:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981318:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687744:0@lo:104: 00000100:00100000:2.0:1789126805.981355:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126805.981405:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981414:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 23 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981422:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687872:0@lo:104: 00000100:00100000:2.0:1789126805.981443:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126805.981463:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981471:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981480:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688000:0@lo:104: 00000100:00100000:2.0:1789126805.981500:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126805.981516:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981525:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 23 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981532:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e098b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688128:0@lo:104: 00000100:00100000:2.0:1789126805.981553:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126805.981568:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981575:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981583:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688256:0@lo:104: 00010000:00010000:2.0:1789126805.981629:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981637:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 23 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981645:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688384:0@lo:104: 00010000:00010000:2.0:1789126805.981703:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981711:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981719:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688512:0@lo:104: 00010000:00010000:2.0:1789126805.981741:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981749:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 23 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981755:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688640:0@lo:104: 00010000:00010000:2.0:1789126805.981777:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.981785:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.981793:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688768:0@lo:104: 00000100:00100000:2.0:1789126805.981810:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789126805.982095:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789126805.982115:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.982128:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.982137:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.982144:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.982152:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.982160:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276687744 00000100:00100000:0.0:1789126805.982167:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276687744 00000100:00100000:0.0:1789126805.982204:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276687872 00000100:00100000:0.0:1789126805.982207:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276687872 00000100:00100000:0.0:1789126805.982217:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688000 00000100:00100000:0.0:1789126805.982219:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688000 00000100:00100000:0.0:1789126805.982227:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688128 00000100:00100000:0.0:1789126805.982229:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688128 00000100:00100000:0.0:1789126805.982248:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688256 00000100:00100000:0.0:1789126805.982251:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688256 00000100:00100000:0.0:1789126805.982260:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688384 00000100:00100000:0.0:1789126805.982262:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688384 00000100:00100000:0.0:1789126805.982270:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688512 00000100:00100000:0.0:1789126805.982272:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688512 00000100:00100000:0.0:1789126805.982281:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688640 00000100:00100000:0.0:1789126805.982283:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688640 00000100:00100000:0.0:1789126805.982292:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688768 00000100:00100000:0.0:1789126805.982294:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688768 00000100:00100000:0.0:1789126805.982307:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126805.982315:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+11:10325:x1876035276687744:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982329:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982380:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126805.982385:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+11:10325:x1876035276687744:12345-0@lo:104: Request processed in 72us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982392:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126805.982409:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126805.982415:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+10:10325:x1876035276687872:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982422:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982457:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789126805.982462:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+10:10325:x1876035276687872:12345-0@lo:104: Request processed in 48us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982467:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126805.982479:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126805.982485:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+9:10325:x1876035276688000:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982500:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982534:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789126805.982539:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+9:10325:x1876035276688000:12345-0@lo:104: Request processed in 55us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982545:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126805.982559:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126805.982565:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+8:10325:x1876035276688128:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982572:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982603:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789126805.982608:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+8:10325:x1876035276688128:12345-0@lo:104: Request processed in 44us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982614:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126805.982642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126805.982669:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104133840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+7:10325:x1876035276688256:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982676:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982703:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789126805.982709:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104133840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+7:10325:x1876035276688256:12345-0@lo:104: Request processed in 61us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126805.982741:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126805.982747:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:10325:x1876035276688384:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982761:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982787:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789126805.982792:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:10325:x1876035276688384:12345-0@lo:104: Request processed in 46us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982798:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126805.982811:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789126805.982817:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:10325:x1876035276688512:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982823:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982849:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789126805.982854:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:10325:x1876035276688512:12345-0@lo:104: Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982860:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789126805.982883:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126805.982889:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:10325:x1876035276688640:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982896:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982923:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1789126805.982928:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:10325:x1876035276688640:12345-0@lo:104: Request processed in 40us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.982933:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126805.982945:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789126805.982950:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:10325:x1876035276688768:12345-0@lo:104: 00010000:00010000:0.0:1789126805.982963:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.982990:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1789126805.982994:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:10325:x1876035276688768:12345-0@lo:104: Request processed in 45us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.983011:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789126805.983033:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1789126805.983040:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983047:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983051:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983060:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983067:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983074:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983105:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983112:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983129:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983137:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994200030c00/0xa840b4da666ea921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea928 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983157:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789126805.983160:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983165:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983168:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983175:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983181:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983186:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983200:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983206:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983212:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983218:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589200/0xa840b4da666ea8f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983227:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789126805.983230:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983246:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983250:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983256:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983262:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983267:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983281:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983287:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983302:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983307:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148f000/0xa840b4da666ea8d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983317:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789126805.983319:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983325:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983327:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983345:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983351:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983356:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983369:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983374:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983379:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983385:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ea8b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea8b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983394:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789126805.983397:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983403:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983405:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983411:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983416:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983427:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983440:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983445:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983450:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983456:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994200030000/0xa840b4da666ea895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea89c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983465:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789126805.983467:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983472:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983475:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983481:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983488:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983493:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983503:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983508:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983517:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983523:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666ea887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea88e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983533:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789126805.983536:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983542:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983544:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983551:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983557:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983562:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983573:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983578:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983582:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983588:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea880 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983596:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126805.983603:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983608:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983611:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983618:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983624:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983629:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983641:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983665:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983670:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983675:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ea83a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea841 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983683:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126805.983686:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983692:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126805.983694:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983711:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126805.983716:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126805.983720:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789126805.983732:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983736:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126805.983739:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983745:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ea810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea817 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.983756:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.983758:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.983759:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.983766:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.983771:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126805.983776:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126805.983794:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276688896:0@lo:103: 00000100:00100000:0.0:1789126805.983829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.983849:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689408:0@lo:103: 00000100:00100000:0.0:1789126805.983877:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.983894:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689920:0@lo:103: 00000100:00100000:0.0:1789126805.983921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.983941:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789126805.983947:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689024:0@lo:103: 00000100:00100000:0.0:1789126805.983977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.983996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689536:0@lo:103: 00000100:00100000:0.0:1789126805.984026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.984050:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689152:0@lo:103: 00000100:00100000:0.0:1789126805.984069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.984079:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689664:0@lo:103: 00000100:00100000:0.0:1789126805.984095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.984105:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789126805.984109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689280:0@lo:103: 00000100:00100000:0.0:1789126805.984129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.984138:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689792:0@lo:103: 00000100:00100000:0.0:1789126805.984155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126805.984179:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276688896 00000100:00100000:0.0:1789126805.984183:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276688896 00010000:00010000:0.0:1789126805.984206:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 24 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984221:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689408 00000100:00100000:0.0:1789126805.984224:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689408 00010000:00010000:0.0:1789126805.984233:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 25 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984244:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689920 00000100:00100000:0.0:1789126805.984246:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689920 00010000:00010000:0.0:1789126805.984256:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 26 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984272:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689024 00000100:00100000:0.0:1789126805.984275:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689024 00010000:00010000:0.0:1789126805.984285:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 27 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984294:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689536 00000100:00100000:0.0:1789126805.984297:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689536 00010000:00010000:0.0:1789126805.984305:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 28 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984314:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689152 00000100:00100000:0.0:1789126805.984317:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689152 00010000:00010000:0.0:1789126805.984326:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 29 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984336:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689664 00000100:00100000:0.0:1789126805.984338:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689664 00010000:00010000:0.0:1789126805.984347:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 30 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984356:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689280 00000100:00100000:0.0:1789126805.984358:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689280 00010000:00010000:0.0:1789126805.984366:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 31 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984374:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276689792 00000100:00100000:0.0:1789126805.984376:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276689792 00010000:00010000:0.0:1789126805.984385:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 32 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.984397:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126805.984411:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+32:3641:x1876035276688896:12345-0@lo:103: 00010000:00010000:0.0:1789126805.984423:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.984429:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 32 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984438:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 32 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984455:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.984486:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+32:3641:x1876035276688896:12345-0@lo:103: Request processed in 77us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.984493:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789126805.984528:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126805.984534:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+31:3641:x1876035276689408:12345-0@lo:103: 00010000:00010000:0.0:1789126805.984541:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.984546:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 31 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984554:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 31 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984564:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.984586:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+31:3641:x1876035276689408:12345-0@lo:103: Request processed in 51us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.984592:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126805.984604:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126805.984610:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+30:3641:x1876035276689920:12345-0@lo:103: 00010000:00010000:0.0:1789126805.984617:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.984626:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 30 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984634:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 30 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984643:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.984687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+30:3641:x1876035276689920:12345-0@lo:103: Request processed in 77us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.984693:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126805.984705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126805.984711:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+29:3641:x1876035276689024:12345-0@lo:103: 00010000:00010000:0.0:1789126805.984718:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.984723:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 29 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984730:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 29 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984739:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.984759:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+29:3641:x1876035276689024:12345-0@lo:103: Request processed in 49us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.984764:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126805.984775:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126805.984780:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+28:3641:x1876035276689536:12345-0@lo:103: 00010000:00010000:0.0:1789126805.984786:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.984790:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 28 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984808:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 28 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.984817:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.984840:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+28:3641:x1876035276689536:12345-0@lo:103: Request processed in 61us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.984847:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126805.984858:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126805.984864:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+27:3639:x1876035276689152:12345-0@lo:103: 00010000:00010000:2.0:1789126805.985875:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3000/0xa840b4da666ea928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea921 expref: 27 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.985891:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687744:0@lo:104: 00010000:00010000:2.0:1789126805.985905:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589a00/0xa840b4da666ea8fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea8f7 expref: 26 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.985913:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687872:0@lo:104: 00000100:00100000:2.0:1789126805.985922:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688000:0@lo:104: 00000100:00100000:2.0:1789126805.985930:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e098b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688128:0@lo:104: 00010000:00010000:2.0:1789126805.985938:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ec00/0xa840b4da666ea89c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea895 expref: 25 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.985947:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688256:0@lo:104: 00010000:00010000:2.0:1789126805.985957:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea88e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea887 expref: 24 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.985964:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688384:0@lo:104: 00000100:00100000:2.0:1789126805.985973:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688512:0@lo:104: 00000100:00100000:2.0:1789126805.985980:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688640:0@lo:104: 00010000:00010000:2.0:1789126805.985988:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f800/0xa840b4da666ea817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea810 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126805.986210:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276688768:0@lo:104: 00000100:00100000:2.0:1789126805.990245:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687488:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126805.990763:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789126805.990781:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276689664:12345-0@lo:103: 00010000:00010000:2.0:1789126805.990813:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126805.990823:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 22 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.990837:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 22 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.990856:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200031200/0xa840b4da666ea880 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea879 expref: 22 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.990881:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126805.990952:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+21:3639:x1876035276689664:12345-0@lo:103: Request processed in 180us (6855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126805.990960:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789126805.990987:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789126805.990994:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+20:3639:x1876035276689280:12345-0@lo:103: 00010000:00010000:2.0:1789126805.991002:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126805.991007:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 20 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991015:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 20 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991025:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588800/0xa840b4da666ea8b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea8b1 expref: 20 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991034:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126805.991369:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+19:3639:x1876035276689280:12345-0@lo:103: Request processed in 375us (7238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126805.991384:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789126805.991398:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126805.991404:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+18:3639:x1876035276689792:12345-0@lo:103: 00010000:00010000:2.0:1789126805.991412:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126805.991416:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 18 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991425:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 18 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991435:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200031c00/0xa840b4da666ea841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea83a expref: 18 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126805.991443:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126805.996249:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689280:0@lo:103: 00000100:00100000:3.0:1789126805.996269:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689664:0@lo:103: 00000100:00100000:0.0:1789126805.996866:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689024:0@lo:103: 00000100:00100000:0.0:1789126805.996888:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689536:0@lo:103: 00000100:00100000:0.0:1789126805.996898:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276688896:0@lo:103: 00000100:00100000:0.0:1789126805.996905:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689408:0@lo:103: 00000100:00100000:0.0:1789126805.996913:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276689920:0@lo:103: 00010000:00010000:0.0:1789126805.996949:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126805.996959:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 17 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.996972:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 17 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.997000:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589600/0xa840b4da666ea8e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea8d4 expref: 17 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126805.997020:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126805.997092:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+16:3639:x1876035276689152:12345-0@lo:103: Request processed in 12226us (13020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126805.997103:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126805.997148:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689152:0@lo:103: 00000100:00100000:2.0:1789126805.998097:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+15:3639:x1876035276689792:12345-0@lo:103: Request processed in 6690us (13938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126805.998105:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126805.998150:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1876035276687616:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126805.998193:0:10325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126805.998410:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276689792:0@lo:103: 00000100:00100000:3.0:1789126806.000319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126806.000367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126806.000480:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815104 00000100:00100000:0.0:1789126806.000488:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815104 00010000:00010000:0.0:1789126806.000528:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 10 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126806.000564:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815232 00000100:00100000:0.0:1789126806.000567:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815232 00010000:00010000:0.0:1789126806.000580:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 11 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126806.000607:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1789126806.000617:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2394:x1876035258815104:12345-192.168.203.23@tcp:103: 00010000:00010000:0.0:1789126806.000631:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126806.000637:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 11 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000687:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 11 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000707:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3800/0xa840b4da666ea93d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c219 expref: 11 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000723:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126806.000769:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2394:x1876035258815104:12345-192.168.203.23@tcp:103: Request processed in 153us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.000788:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1789126806.000804:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1789126806.000810:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:2393:x1876035258815232:12345-192.168.203.23@tcp:103: 00010000:00010000:0.0:1789126806.000818:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126806.000823:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000832:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000843:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ea936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c212 expref: 9 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000854:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000862:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000887:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000895:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000901:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000908:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000919:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126806.000923:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000932:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000946:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126806.000955:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126806.000976:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:2393:x1876035258815232:12345-192.168.203.23@tcp:103: Request processed in 165us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.000983:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00010000:00010000:2.0:1789126806.001442:0:10325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126806.001451:0:10325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126806.001457:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2800/0xa840b4da666ea97c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126806.186947:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276690304:0@lo:400: 00000100:00100000:1.0:1789126806.187078:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276690432:0@lo:400: 00000100:00100000:1.0:1789126806.187127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187179:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276690944:0@lo:400: 00000100:00100000:1.0:1789126806.187204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187227:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276691456:0@lo:400: 00000100:00100000:1.0:1789126806.187250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187275:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789126806.187294:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276690048:0@lo:400: 00000100:00100000:1.0:1789126806.187319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187337:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276690560:0@lo:400: 00000100:00100000:1.0:1789126806.187361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187381:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276691072:0@lo:400: 00000100:00100000:1.0:1789126806.187401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.187433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690432 00000100:00100000:1.0:1789126806.187439:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690432 00000100:00100000:1.0:1789126806.187482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789126806.187491:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276690432:12345-0@lo:400: 00000100:00100000:1.0:1789126806.187545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276690432:12345-0@lo:400: Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.187552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789126806.187575:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690944 00000100:00100000:1.0:1789126806.187579:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690944 00000100:00100000:1.0:1789126806.187611:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691456 00000100:00100000:1.0:1789126806.187614:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691456 00000100:00100000:1.0:1789126806.187632:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789126806.187638:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276690944:12345-0@lo:400: 00000100:00100000:1.0:1789126806.187702:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276690944:12345-0@lo:400: Request processed in 64us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.187708:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789126806.187720:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789126806.187726:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276691456:12345-0@lo:400: 00000100:00100000:1.0:1789126806.187753:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276691456:12345-0@lo:400: Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.187759:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789126806.187793:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690048 00000100:00100000:1.0:1789126806.187797:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690048 00000100:00100000:1.0:1789126806.187820:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690560 00000100:00100000:1.0:1789126806.187823:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690560 00000100:00100000:1.0:1789126806.187834:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691072 00000100:00100000:1.0:1789126806.187836:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691072 00000100:00100000:1.0:1789126806.187850:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126806.187855:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276690048:12345-0@lo:400: 00000100:00100000:1.0:1789126806.187897:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276690048:12345-0@lo:400: Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.187903:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126806.187914:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126806.187920:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276690560:12345-0@lo:400: 00000100:00100000:1.0:1789126806.187946:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276690560:12345-0@lo:400: Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.187952:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126806.187963:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789126806.187968:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276691072:12345-0@lo:400: 00000100:00100000:1.0:1789126806.188145:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276691072:12345-0@lo:400: Request processed in 176us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.188152:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789126806.188180:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126806.188185:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126806.188187:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126806.188249:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276690048:0@lo:400: 00000100:00100000:1.0:1789126806.188262:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276690560:0@lo:400: 00000100:00100000:1.0:1789126806.188270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276691072:0@lo:400: 00000100:00100000:1.0:1789126806.188289:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276690432:0@lo:400: 00010000:00080000:1.0:1789126806.188299:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415b840 x1876035276690944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126806.188310:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276690944:0@lo:400: 00010000:00080000:1.0:1789126806.188320:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104158f00 x1876035276691456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126806.188328:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276691456:0@lo:400: 00000100:00100000:1.0:1789126806.188350:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126806.188357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276691584:0@lo:13: 00000100:00100000:3.0:1789126806.188583:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276690176:0@lo:400: 00000100:00100000:0.0:1789126806.188756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126806.188789:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276690816:0@lo:400: 00000100:00100000:0.0:1789126806.188814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126806.188836:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276691328:0@lo:400: 00000100:00100000:0.0:1789126806.188856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126806.188889:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126806.188894:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276691712:0@lo:13: 00000100:00100000:0.0:1789126806.188921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126806.188946:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691712 00000100:00100000:0.0:1789126806.188951:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691712 00000100:00100000:0.0:1789126806.188979:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789126806.188985:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276691712:12345-0@lo:13: 00002000:00000024:0.0:1789126806.189028:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126806.189078:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276691712:12345-0@lo:13: Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.189084:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789126806.189110:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041030c0 x1876035276691712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126806.189123:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276691712:0@lo:13: 00000100:00100000:2.0:1789126806.189264:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690304 00000100:00100000:2.0:1789126806.189268:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690304 00000100:00100000:2.0:1789126806.189302:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789126806.189309:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276690304:12345-0@lo:400: 00000100:00100000:2.0:1789126806.189350:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276690304:12345-0@lo:400: Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126806.189356:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789126806.189383:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276690304:0@lo:400: 00000100:00100000:1.0:1789126806.189542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126806.189606:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690816 00000100:00100000:1.0:1789126806.189611:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690816 00000100:00100000:1.0:1789126806.189672:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691328 00000100:00100000:1.0:1789126806.189676:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691328 00000100:00100000:1.0:1789126806.189693:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126806.189699:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276690816:12345-0@lo:400: 00000100:00100000:1.0:1789126806.189732:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276690816:12345-0@lo:400: Request processed in 33us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.189737:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789126806.189748:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789126806.189754:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276691328:12345-0@lo:400: 00000100:00100000:1.0:1789126806.189777:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276691328:12345-0@lo:400: Request processed in 24us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126806.189782:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789126806.189841:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789126806.189845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789126806.189862:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415a580 x1876035276690816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126806.189882:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276690816:0@lo:400: 00010000:00080000:2.0:1789126806.189892:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041583c0 x1876035276691328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126806.189900:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276691328:0@lo:400: 00000100:00100000:0.0:1789126806.189996:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691584 00000100:00100000:0.0:1789126806.190000:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691584 00000100:00100000:0.0:1789126806.190032:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789126806.190038:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276691584:12345-0@lo:13: 00002000:00000024:0.0:1789126806.190048:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126806.190248:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276691584:12345-0@lo:13: Request processed in 210us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.190255:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789126806.190312:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d3840 x1876035276691584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126806.190334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276691584:0@lo:13: 00000100:00100000:3.0:1789126806.190403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126806.190435:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276690688:0@lo:400: 00000100:00100000:3.0:1789126806.190462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126806.190518:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276691200:0@lo:400: 00000100:00100000:3.0:1789126806.190539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126806.190608:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690176 00000100:00100000:0.0:1789126806.190612:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690176 00000100:00100000:0.0:1789126806.190667:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789126806.190675:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276690176:12345-0@lo:400: 00000100:00100000:0.0:1789126806.190712:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276690176:12345-0@lo:400: Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.190719:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789126806.191447:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276690176:0@lo:400: 00000100:00100000:1.0:1789126806.195787:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276690688 00000100:00100000:1.0:1789126806.195804:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276690688 00000100:00100000:1.0:1789126806.195928:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691200 00000100:00100000:1.0:1789126806.195932:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691200 00000100:00080000:2.0:1789126806.197380:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126806.197459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789126806.197480:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276690688:12345-0@lo:400: 00000100:00100000:3.0:1789126806.197642:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789126806.197666:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276691200:12345-0@lo:400: 00000100:00100000:0.0:1789126806.197737:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276690688:12345-0@lo:400: Request processed in 268us (7273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126806.197760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789126806.198440:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276691200:12345-0@lo:400: Request processed in 774us (7896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126806.198448:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789126806.198504:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415a940 x1876035276690688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126806.198518:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276690688:0@lo:400: 00010000:00080000:2.0:1789126806.198535:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415bc00 x1876035276691200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126806.198544:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276691200:0@lo:400: 00010000:00010000:0.0:1789126806.955356:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126807.053988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126807.054208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815360 00000100:00100000:1.0:1789126807.054218:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815360 00000100:00100000:1.0:1789126807.054275:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:1.0:1789126807.054285:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:6161:x1876035258815360:12345-192.168.203.23@tcp:101: 00010000:00010000:1.0:1789126807.054300:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126807.054321:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588a00/0xa840b4da666ea983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c289 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.054351:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588a00/0xa840b4da666ea983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c289 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.054363:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588a00/0xa840b4da666ea983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c289 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.054373:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588a00, rc 0) 00000100:00100000:1.0:1789126807.054443:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258815360:12345-192.168.203.23@tcp:101: Request processed in 159us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.054451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:0.0:1789126807.062465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126807.062553:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815488 00000100:00100000:2.0:1789126807.062564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815488 00000100:00100000:2.0:1789126807.062620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1789126807.062631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258815488:12345-192.168.203.23@tcp:501: 00000100:00100000:2.0:1789126807.062820:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258815488:12345-192.168.203.23@tcp:501: Request processed in 191us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.062829:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1789126807.066046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126807.066128:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815616 00000100:00100000:3.0:1789126807.066136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815616 00000100:00100000:3.0:1789126807.066185:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:3.0:1789126807.066194:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258815616:12345-192.168.203.23@tcp:503: 00000100:00100000:3.0:1789126807.067466:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258815616:12345-192.168.203.23@tcp:503: Request processed in 1266us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.067477:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:3.0:1789126807.075252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126807.075512:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815744 00000100:00100000:1.0:1789126807.075522:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815744 00000100:00100000:1.0:1789126807.075578:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:1.0:1789126807.075588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6636:x1876035258815744:12345-192.168.203.23@tcp:502: 00000100:00100000:1.0:1789126807.075785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6636:x1876035258815744:12345-192.168.203.23@tcp:502: Request processed in 197us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.075793:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:0.0:1789126807.089185:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126807.089269:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258815872 00000100:00100000:3.0:1789126807.089278:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258815872 00000100:00100000:3.0:1789126807.089356:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:3.0:1789126807.089367:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6636:x1876035258815872:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789126807.089530:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6636:x1876035258815872:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 165us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.089538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:3.0:1789126807.098087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126807.098180:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816000 00000100:00100000:2.0:1789126807.098190:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816000 00000100:00100000:2.0:1789126807.098242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:2.0:1789126807.098252:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258816000:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126807.098269:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126807.098288:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea98a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c290 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.098317:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c290 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.098329:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c290 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.098337:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:2.0:1789126807.098403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816000:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.098410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1789126807.101536:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126807.101622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816128 00000100:00100000:1.0:1789126807.101631:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816128 00000100:00100000:1.0:1789126807.101719:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:1.0:1789126807.101731:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816128:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.101840:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816128:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 112us (312us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126807.101848:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 10000000:01000000:2.0:1789126807.349892:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789126807.349912:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994102d1e800 from 48 10000000:01000000:2.0:1789126807.349918:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789126807.349963:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.349975:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.349987:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126807.350010:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276691840:0@lo:101: 00000100:00100000:2.0:1789126807.350078:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126807.350134:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691840 00000100:00100000:3.0:1789126807.350142:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691840 00000100:00100000:2.0:1789126807.350142:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.350192:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789126807.350201:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+15:6509:x1876035276691840:12345-0@lo:101: 00010000:00010000:3.0:1789126807.350213:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126807.350226:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ee00/0xa840b4da666ea998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea991 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.350250:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ee00/0xa840b4da666ea998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea991 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.350261:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ee00/0xa840b4da666ea998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea991 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.350270:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ee00, rc 0) 00000100:00100000:3.0:1789126807.350381:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276691840:12345-0@lo:101: Request processed in 180us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.350388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789126807.350498:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276691840:0@lo:101: 00010000:00010000:2.0:1789126807.350512:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.350522:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126807.350633:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276691968:0@lo:501: 00000100:00100000:2.0:1789126807.351206:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.351279:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.351357:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276691968 00000100:00100000:1.0:1789126807.351362:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276691968 00000100:00100000:1.0:1789126807.351436:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789126807.351445:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276691968:12345-0@lo:501: 00000100:00100000:1.0:1789126807.351577:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276691968:12345-0@lo:501: Request processed in 132us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.351583:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789126807.351671:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276691968:0@lo:501: 00000100:00100000:3.0:1789126807.351724:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692096:0@lo:503: 00000100:00100000:3.0:1789126807.351790:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126807.352293:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.352335:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692096 00000100:00100000:2.0:1789126807.352340:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692096 00000100:00100000:2.0:1789126807.352367:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789126807.352374:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276692096:12345-0@lo:503: 00000100:00100000:2.0:1789126807.352467:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276692096:12345-0@lo:503: Request processed in 93us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.352480:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789126807.352520:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692096:0@lo:503: 00000100:00100000:2.0:1789126807.352769:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10343:1876035276692224:0@lo:502: 00000100:00100000:2.0:1789126807.352819:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.353237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692224 00000100:00100000:2.0:1789126807.353243:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692224 00000100:00100000:2.0:1789126807.353266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789126807.353273:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:10343:x1876035276692224:12345-0@lo:502: 00000100:00100000:2.0:1789126807.353370:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:10343:x1876035276692224:12345-0@lo:502: Request processed in 97us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.353377:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789126807.353408:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.353423:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10343:1876035276692224:0@lo:502: 00000100:00100000:2.0:1789126807.353462:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10343:1876035276692352:0@lo:502: 00000100:00100000:2.0:1789126807.353495:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.353516:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692352 00000100:00100000:2.0:1789126807.353519:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692352 00000100:00100000:2.0:1789126807.353537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789126807.353543:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:10343:x1876035276692352:12345-0@lo:502: 00000100:00100000:2.0:1789126807.353600:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:10343:x1876035276692352:12345-0@lo:502: Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.353607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789126807.353633:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.353645:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10343:1876035276692352:0@lo:502: 00000040:00080000:2.0:1789126807.354000:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789126807.354073:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789126807.354096:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789126807.354106:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354117:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126807.354126:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789126807.354128:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789126807.354131:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789126807.354157:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354165:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354174:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126807.354188:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692480:0@lo:101: 00000100:00100000:2.0:1789126807.354220:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.354235:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.354247:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692480 00000100:00100000:2.0:1789126807.354250:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692480 00000100:00100000:2.0:1789126807.354269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789126807.354275:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+16:6509:x1876035276692480:12345-0@lo:101: 00010000:00010000:2.0:1789126807.354283:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126807.354301:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2400/0xa840b4da666ea9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea99f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354407:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2400/0xa840b4da666ea9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea99f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354418:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ea9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea99f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354427:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2400, rc 0) 00000100:00100000:2.0:1789126807.354458:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276692480:12345-0@lo:101: Request processed in 183us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.354465:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789126807.354495:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692480:0@lo:101: 00010000:00010000:2.0:1789126807.354506:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126807.354515:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126807.354555:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692608:0@lo:501: 00000100:00100000:2.0:1789126807.354577:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.354591:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.354601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692608 00000100:00100000:2.0:1789126807.354604:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692608 00000100:00100000:2.0:1789126807.354620:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789126807.354626:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276692608:12345-0@lo:501: 00000100:00100000:2.0:1789126807.355215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276692608:12345-0@lo:501: Request processed in 586us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.355233:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789126807.355309:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104102d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692608:0@lo:501: 00000100:00100000:1.0:1789126807.355395:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692736:0@lo:503: 00000100:00100000:1.0:1789126807.355433:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.355454:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126807.355507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692736 00000100:00100000:2.0:1789126807.355512:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692736 00000100:00100000:2.0:1789126807.355574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789126807.355582:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276692736:12345-0@lo:503: 00000100:00100000:2.0:1789126807.355691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276692736:12345-0@lo:503: Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.355698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789126807.356157:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276692736:0@lo:503: 00000100:00100000:1.0:1789126807.356342:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10344:1876035276692864:0@lo:502: 00000100:00100000:1.0:1789126807.356381:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.356407:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692864 00000100:00100000:1.0:1789126807.356411:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692864 00000100:00100000:1.0:1789126807.356432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789126807.356438:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:10344:x1876035276692864:12345-0@lo:502: 00000100:00100000:1.0:1789126807.356511:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:10344:x1876035276692864:12345-0@lo:502: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.356518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789126807.356557:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.356568:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10344:1876035276692864:0@lo:502: 00000020:01000000:1.0:1789126807.356588:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126807.356596:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.356598:0:10344:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789126807.356603:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789126807.356627:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10344:1876035276692992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.356690:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.356719:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276692992 00000100:00100000:1.0:1789126807.356723:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276692992 00000100:00100000:1.0:1789126807.356740:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789126807.356755:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:10344:x1876035276692992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.356823:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:10344:x1876035276692992:12345-0@lo:502:llog_process_th.0 Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.356830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789126807.357124:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.357138:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10344:1876035276692992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126807.357156:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126807.357161:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.357162:0:10344:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789126807.357171:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789126807.357222:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789126807.357239:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789126807.357248:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357258:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126807.357267:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789126807.357270:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994220b43000 from 48 10000000:01000000:1.0:1789126807.357273:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789126807.357295:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357304:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357321:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.357335:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.357362:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.357375:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.357387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693120 00000100:00100000:1.0:1789126807.357390:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693120 00000100:00100000:1.0:1789126807.357408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789126807.357414:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+17:6509:x1876035276693120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.357422:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126807.357434:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588000/0xa840b4da666ea9b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9ad expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357460:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588000/0xa840b4da666ea9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9ad expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357469:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588000/0xa840b4da666ea9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9ad expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357477:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588000, rc 0) 00000100:00100000:1.0:1789126807.357506:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.357512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789126807.357544:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.357556:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.357565:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.357604:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.357631:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.357642:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.357673:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693248 00000100:00100000:1.0:1789126807.357677:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693248 00000100:00100000:1.0:1789126807.357695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789126807.357700:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.358110:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 409us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.358128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789126807.358162:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.358189:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.358225:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.358237:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.358249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693376 00000100:00100000:1.0:1789126807.358252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693376 00000100:00100000:1.0:1789126807.358269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789126807.358274:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.358353:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.358359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789126807.358396:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.358607:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10345:1876035276693504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.358644:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.358683:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693504 00000100:00100000:1.0:1789126807.358687:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693504 00000100:00100000:1.0:1789126807.358703:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789126807.358722:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:10345:x1876035276693504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.359172:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+18:10345:x1876035276693504:12345-0@lo:502:llog_process_th.0 Request processed in 450us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.359179:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789126807.359211:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce780 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.359225:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10345:1876035276693504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.359269:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10345:1876035276693632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.359304:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.359449:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693632 00000100:00100000:2.0:1789126807.359453:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693632 00000100:00100000:2.0:1789126807.359475:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789126807.359481:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:10345:x1876035276693632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126807.359545:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:10345:x1876035276693632:12345-0@lo:502:llog_process_th.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126807.359552:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789126807.365432:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.365471:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10345:1876035276693632:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789126807.365517:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789126807.365664:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789126807.365684:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789126807.365693:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.365704:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126807.365713:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789126807.365715:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789126807.365718:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789126807.365750:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.365758:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.365767:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.365786:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.365854:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.366965:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.366991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693760 00000100:00100000:0.0:1789126807.366997:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693760 00000100:00100000:0.0:1789126807.367051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789126807.367060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+18:6509:x1876035276693760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.367073:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126807.367086:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb400/0xa840b4da666ea9c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9bb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.367126:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb400/0xa840b4da666ea9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9bb expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.367137:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb400/0xa840b4da666ea9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9bb expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.367146:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb400, rc 0) 00000100:00100000:0.0:1789126807.367193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276693760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.367200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789126807.367242:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.367256:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.367264:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.367322:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.367357:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.367366:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.367737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276693888 00000100:00100000:1.0:1789126807.367743:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276693888 00000100:00100000:1.0:1789126807.367785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789126807.367798:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276693888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.367932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276693888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.367939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789126807.368501:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276693888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.368543:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.368595:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126807.368627:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520540 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.368643:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694016 00000100:00100000:3.0:1789126807.368669:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694016 00000100:00100000:0.0:1789126807.369840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789126807.369855:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276694016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.370218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276694016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.370227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789126807.370308:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.370596:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10346:1876035276694144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126807.370634:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.370782:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942038fa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.370999:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694144 00000100:00100000:1.0:1789126807.371005:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694144 00000100:00100000:1.0:1789126807.371039:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789126807.371046:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:10346:x1876035276694144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.371123:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:10346:x1876035276694144:12345-0@lo:502:llog_process_th.0 Request processed in 77us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.371130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789126807.371267:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10346:1876035276694144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126807.371290:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126807.371299:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126807.371302:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789126807.371306:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789126807.371332:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10346:1876035276694272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126807.371366:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.371381:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.371420:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694272 00000100:00100000:1.0:1789126807.371424:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694272 00000100:00100000:1.0:1789126807.371449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789126807.371456:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:10346:x1876035276694272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.371514:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:10346:x1876035276694272:12345-0@lo:502:llog_process_th.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.371531:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789126807.371590:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10346:1876035276694272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126807.371607:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126807.371611:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126807.371614:0:10346:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789126807.371617:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789126807.372218:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789126807.372240:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789126807.372250:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.372260:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126807.372270:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789126807.372272:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99423d256000 from 48 10000000:01000000:1.0:1789126807.372275:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789126807.372302:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.372310:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.372318:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.372334:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.372370:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.372434:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230ba3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.372468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694400 00000100:00100000:0.0:1789126807.372473:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694400 00000100:00100000:1.0:1789126807.374549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789126807.374561:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+19:6509:x1876035276694400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.374578:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126807.374596:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589600/0xa840b4da666ea9d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9c9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.374639:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589600/0xa840b4da666ea9d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9c9 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.374670:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589600/0xa840b4da666ea9d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9c9 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.374680:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589600, rc 0) 00000100:00100000:1.0:1789126807.374742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276694400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.374749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789126807.374790:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.374807:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.374816:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.374895:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.374926:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.375027:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694528 00000100:00100000:0.0:1789126807.375033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694528 00000100:00100000:0.0:1789126807.375069:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789126807.375083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276694528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.375208:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230ba3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.375400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276694528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.375407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789126807.375463:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.375492:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.375529:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.375550:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.375586:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694656 00000100:00100000:1.0:1789126807.375589:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694656 00000100:00100000:1.0:1789126807.375617:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789126807.375624:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276694656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.375724:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276694656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.375731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789126807.375803:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276694656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.376229:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10347:1876035276694784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126807.376265:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.376290:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.376328:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694784 00000100:00100000:1.0:1789126807.376332:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694784 00000100:00100000:1.0:1789126807.376365:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789126807.376371:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:10347:x1876035276694784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.376522:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:10347:x1876035276694784:12345-0@lo:502:llog_process_th.0 Request processed in 150us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.376529:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789126807.376642:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10347:1876035276694784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126807.376708:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10347:1876035276694912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126807.376739:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.376755:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942296983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.376819:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276694912 00000100:00100000:0.0:1789126807.376823:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276694912 00000100:00100000:0.0:1789126807.376848:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789126807.376854:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+20:10347:x1876035276694912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126807.376949:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+20:10347:x1876035276694912:12345-0@lo:502:llog_process_th.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.376956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789126807.377263:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10347:1876035276694912:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789126807.377285:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789126807.377423:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789126807.377444:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789126807.377452:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.377462:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126807.377471:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789126807.377473:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789126807.377476:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789126807.377499:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.377505:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.377513:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.377533:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.377562:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.377590:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.377629:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695040 00000100:00100000:0.0:1789126807.377633:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695040 00000100:00100000:0.0:1789126807.377685:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789126807.377692:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276695040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.377700:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126807.377712:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cba00/0xa840b4da666ea9de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9d7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.377733:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cba00/0xa840b4da666ea9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9d7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.377749:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cba00/0xa840b4da666ea9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9d7 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.377758:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cba00, rc 0) 00000100:00100000:0.0:1789126807.377789:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.377796:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789126807.377918:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.377929:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.377948:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.377996:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.378018:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.378042:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.378138:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695168 00000100:00100000:0.0:1789126807.378143:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695168 00000100:00100000:0.0:1789126807.378174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789126807.378180:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.378291:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.378298:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789126807.378359:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126807.378386:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126807.378426:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126807.378450:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942296983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.378488:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695296 00000100:00100000:0.0:1789126807.378492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695296 00000100:00100000:0.0:1789126807.378521:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789126807.378527:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.378599:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.378605:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789126807.378640:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.381435:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10349:1876035276695424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126807.381501:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126807.381595:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520240 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.381724:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695424 00000100:00100000:1.0:1789126807.381731:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695424 00000100:00100000:1.0:1789126807.381812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789126807.381822:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:10349:x1876035276695424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.381950:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:10349:x1876035276695424:12345-0@lo:502:llog_process_th.0 Request processed in 129us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.381958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789126807.383879:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10349:1876035276695424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126807.383922:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126807.383932:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.383935:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789126807.383941:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789126807.383981:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10349:1876035276695552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.384118:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.384206:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.384394:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695552 00000100:00100000:3.0:1789126807.384400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695552 00000100:00100000:3.0:1789126807.384480:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789126807.384490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:10349:x1876035276695552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126807.384613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:10349:x1876035276695552:12345-0@lo:502:llog_process_th.0 Request processed in 124us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.384621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789126807.386554:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10349:1876035276695552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126807.386869:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126807.386879:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.386881:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789126807.386887:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789126807.387433:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789126807.387459:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789126807.387470:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387489:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126807.387499:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789126807.387502:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994212236800 from 48 10000000:01000000:0.0:1789126807.387505:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789126807.387551:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387559:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387568:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.387592:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.387686:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.387738:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.387755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695680 00000100:00100000:0.0:1789126807.387760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695680 00000100:00100000:0.0:1789126807.387798:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789126807.387807:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276695680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.387820:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126807.387833:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb000/0xa840b4da666ea9ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9e5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387856:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb000/0xa840b4da666ea9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9e5 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387890:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb000/0xa840b4da666ea9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9e5 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.387898:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb000, rc 0) 00000100:00100000:0.0:1789126807.387937:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276695680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.387944:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789126807.387985:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.388000:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.388008:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.388087:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.388114:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.388137:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.388161:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695808 00000100:00100000:3.0:1789126807.388167:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695808 00000100:00100000:3.0:1789126807.388204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789126807.388213:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276695808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.388345:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276695808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.388352:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789126807.388586:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.388630:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.388706:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.388816:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.388948:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276695936 00000100:00100000:3.0:1789126807.388953:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276695936 00000100:00100000:3.0:1789126807.388987:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789126807.389003:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276695936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.389094:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276695936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.389101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789126807.389177:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276695936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.389511:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10351:1876035276696064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.389551:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.389572:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.389620:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696064 00000100:00100000:3.0:1789126807.389625:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696064 00000100:00100000:3.0:1789126807.389687:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789126807.389705:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10351:x1876035276696064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126807.389793:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10351:x1876035276696064:12345-0@lo:502:llog_process_th.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.389800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789126807.390017:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10351:1876035276696064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.390057:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10351:1876035276696192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.390093:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.390114:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.390492:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696192 00000100:00100000:3.0:1789126807.390497:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696192 00000100:00100000:3.0:1789126807.390530:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789126807.390538:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10351:x1876035276696192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126807.390616:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10351:x1876035276696192:12345-0@lo:502:llog_process_th.0 Request processed in 79us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126807.390623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789126807.390747:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10351:1876035276696192:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789126807.390770:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789126807.391162:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789126807.391197:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789126807.391207:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.391218:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126807.391228:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789126807.391239:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1789126807.391242:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789126807.391273:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.391281:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126807.391290:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126807.391306:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.391349:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126807.391388:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520240 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.391444:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696320 00000100:00100000:1.0:1789126807.391448:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696320 00000100:00100000:1.0:1789126807.391490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789126807.391497:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276696320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.391506:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126807.391518:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589200/0xa840b4da666ea9fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ea9f3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.391540:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589200/0xa840b4da666ea9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ea9f3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.391550:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589200/0xa840b4da666ea9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea9f3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.391558:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589200, rc 0) 00000100:00100000:1.0:1789126807.391592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.391599:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789126807.391633:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.391645:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.391676:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126807.391788:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.391814:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.391828:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.391838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696448 00000100:00100000:1.0:1789126807.391841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696448 00000100:00100000:1.0:1789126807.391876:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789126807.391883:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.391985:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.391991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789126807.392019:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.392043:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.392161:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.392175:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.392187:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696576 00000100:00100000:1.0:1789126807.392191:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696576 00000100:00100000:1.0:1789126807.392205:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789126807.392210:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.392281:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.392288:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789126807.392325:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126807.392493:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10352:1876035276696704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.392543:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.392563:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696704 00000100:00100000:1.0:1789126807.392566:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696704 00000100:00100000:1.0:1789126807.392585:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789126807.392593:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:10352:x1876035276696704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.392682:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:10352:x1876035276696704:12345-0@lo:502:llog_process_th.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.394119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789126807.394186:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.394208:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10352:1876035276696704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126807.394239:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126807.394247:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.394249:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789126807.394255:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789126807.394282:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10352:1876035276696832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126807.394336:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126807.394424:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d133f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789126807.395023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696832 00000100:00100000:0.0:1789126807.395030:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696832 00000100:00100000:0.0:1789126807.395086:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789126807.395096:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:10352:x1876035276696832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126807.395229:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:10352:x1876035276696832:12345-0@lo:502:llog_process_th.0 Request processed in 134us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126807.395237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789126807.395501:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10352:1876035276696832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126807.395529:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126807.395535:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126807.395537:0:10352:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789126807.395542:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789126807.395799:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789126807.395826:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789126807.395841:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.395852:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126807.395872:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789126807.395875:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f0000 from 1 10000000:01000000:0.0:1789126807.395877:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789126807.395905:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.395914:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.395923:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.396290:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.396349:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.396387:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126807.396436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276696960 00000100:00100000:1.0:1789126807.396441:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276696960 00000100:00100000:1.0:1789126807.396485:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789126807.396494:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276696960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126807.396504:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126807.396517:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588800/0xa840b4da666eaa08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa01 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.396540:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588800/0xa840b4da666eaa08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa01 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.396550:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588800/0xa840b4da666eaa08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa01 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126807.396571:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588800, rc 0) 00000100:00100000:1.0:1789126807.396607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276696960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126807.396614:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789126807.397165:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276696960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126807.397180:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.397188:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126807.397245:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276697088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126807.397275:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126807.397340:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789126807.397378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697088 00000100:00100000:3.0:1789126807.397383:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697088 00000100:00100000:3.0:1789126807.397418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789126807.397425:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276697088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126807.397511:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276697088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789126807.397518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789126807.397784:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276697088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789126807.397813:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789126807.397819:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.397826:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126807.979818:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789126808.113404:0:10386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc847f9f0 20000000:00000080:1.0:1789126808.113511:0:10386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99423d1a2400 uarg=0000000000000000 20000000:01000000:1.0:1789126808.113590:0:10386:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789126808.113601:0:10386:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789126808.113609:0:10386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789126808.114889:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789126808.115800:0:10386:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789126808.125026:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789126808.125091:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789126808.125110:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789126808.125130:0:10386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789126808.125150:0:10386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125170:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125189:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125197:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea706 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125204:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ea82c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125214:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125221:0:10386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125262:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125279:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 9 pid: 6507 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.125293:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697216:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126808.125418:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125426:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.125436:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697344:0@lo:104: 00000100:00100000:3.0:1789126808.125492:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126808.125536:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.125544:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.125554:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697472:0@lo:104: 00000100:00100000:3.0:1789126808.125586:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126808.126381:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.126392:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.126407:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697600:0@lo:104: 00010000:00010000:3.0:1789126808.126441:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.126449:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.126457:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697728:0@lo:104: 00000100:00100000:3.0:1789126808.126472:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126808.131892:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697216:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126808.132370:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789126808.132417:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126808.132439:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126808.132449:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697344 00000100:00100000:0.0:1789126808.132455:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697344 00000100:00100000:0.0:1789126808.132499:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697472 00000100:00100000:0.0:1789126808.132501:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697472 00000100:00100000:0.0:1789126808.132512:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697600 00000100:00100000:0.0:1789126808.132514:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697600 00000100:00100000:0.0:1789126808.132522:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697728 00000100:00100000:0.0:1789126808.132524:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697728 00000100:00100000:0.0:1789126808.132536:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789126808.132545:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:10386:x1876035276697344:12345-0@lo:104: 00010000:00010000:0.0:1789126808.132562:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.132640:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126808.132673:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:10386:x1876035276697344:12345-0@lo:104: Request processed in 103us (7155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126808.132695:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789126808.132712:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789126808.132718:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:10386:x1876035276697472:12345-0@lo:104: 00010000:00010000:0.0:1789126808.132726:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.132938:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697344:0@lo:104: 00010000:00010000:0.0:1789126808.133066:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789126808.133072:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:10386:x1876035276697472:12345-0@lo:104: Request processed in 355us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126808.133078:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1789126808.133115:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126808.133121:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133128:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126808.133132:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133141:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126808.133148:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126808.133154:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126808.133191:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133198:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126808.133226:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133234:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ea82c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea833 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133247:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126808.133250:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133256:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126808.133259:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133265:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126808.133271:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126808.133276:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126808.133291:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133296:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789126808.133308:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1789126808.133309:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133315:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166b400/0xa840b4da666ea706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea70d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126808.133316:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1789126808.133325:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126808.133331:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126808.133333:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126808.133354:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276697856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126808.133390:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126808.133444:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126808.133452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276697984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126808.133481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789126808.133531:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126808.133558:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697856 00000100:00100000:0.0:1789126808.133563:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697856 00010000:00010000:0.0:1789126808.133583:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 24 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126808.133616:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276697984 00000100:00100000:0.0:1789126808.133620:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276697984 00010000:00010000:0.0:1789126808.133632:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 25 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126808.133669:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789126808.133676:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+25:3640:x1876035276697856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126808.133686:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126808.133692:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 25 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133701:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 25 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133717:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ea833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea82c expref: 25 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133750:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126808.133780:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276697856:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126808.133787:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789126808.133802:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789126808.133808:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276697984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126808.133815:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126808.133819:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133827:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126808.133836:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126808.133872:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276697984:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126808.133879:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789126808.133908:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276697984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126808.133932:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276697856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126808.134252:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:10386:x1876035276697600:12345-0@lo:104: 00010000:00010000:2.0:1789126808.134263:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126808.134312:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126808.134317:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+4:10386:x1876035276697600:12345-0@lo:104: Request processed in 995us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126808.134323:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789126808.134341:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789126808.134348:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:10386:x1876035276697728:12345-0@lo:104: 00010000:00010000:2.0:1789126808.134356:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126808.134398:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126808.134403:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:10386:x1876035276697728:12345-0@lo:104: Request processed in 57us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126808.134409:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789126808.134456:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789126808.134462:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134468:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126808.134471:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134478:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126808.134485:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126808.134489:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126808.134520:0:9515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134527:0:9515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126808.134551:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134558:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99424216d400/0xa840b4da666ea6b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6b9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134569:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126808.134572:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134577:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126808.134580:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134586:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126808.134591:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126808.134596:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126808.134610:0:9515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134616:0:9515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126808.134628:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134634:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99424216d600/0xa840b4da666ea6a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ea6ab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.134669:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126808.134677:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126808.134678:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126808.134686:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126808.134696:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276698112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126808.134731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126808.134844:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276698240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126808.134881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126808.134907:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698112 00000100:00100000:1.0:1789126808.134912:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698112 00010000:00010000:1.0:1789126808.134933:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126808.134952:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698240 00000100:00100000:1.0:1789126808.134955:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698240 00010000:00010000:1.0:1789126808.134966:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 24 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126808.134987:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789126808.134994:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276698112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126808.135003:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126808.135007:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 24 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.135016:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 24 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.135028:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126808.135055:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276698112:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.135061:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789126808.135085:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789126808.135092:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276698240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126808.135099:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126808.135104:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.135112:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 23 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.135121:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126808.135147:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276698240:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.135154:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789126808.135208:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276698112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126808.135228:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276698240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126808.135344:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126808.136999:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148fa00/0xa840b4da666ea70d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea706 expref: 22 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.137047:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697472:0@lo:104: 00010000:00010000:3.0:1789126808.137191:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589e00/0xa840b4da666ea6b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea6b2 expref: 21 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.137202:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697600:0@lo:104: 00010000:00010000:3.0:1789126808.137213:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589800/0xa840b4da666ea6ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ea6a4 expref: 20 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126808.137221:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1876035276697728:0@lo:104: 00010000:00010000:3.0:1789126808.137249:0:10386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126808.137632:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126808.137885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816256 00000100:00100000:1.0:1789126808.137892:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816256 00010000:00010000:1.0:1789126808.137926:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126808.137954:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1789126808.137964:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2394:x1876035258816256:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126808.138123:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126808.138130:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138142:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138171:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2200/0xa840b4da666ea94b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c251 expref: 10 pid: 6507 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138186:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138195:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138209:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138216:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138223:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138229:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138235:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126808.138239:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138247:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138261:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.138281:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126808.138372:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:2394:x1876035258816256:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 408us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.138379:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00010000:00010000:3.0:1789126808.138495:0:10386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.138503:0:10386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126808.138508:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa0f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126808.239171:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276698368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126808.239249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126808.239546:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698368 00000100:00100000:3.0:1789126808.239555:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698368 00000100:00100000:3.0:1789126808.239610:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789126808.239625:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276698368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126808.239685:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126808.239749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276698368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126808.239801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276698368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126808.241209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126808.747024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276698496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126808.747099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126808.747338:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698496 00000100:00100000:3.0:1789126808.747346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698496 00000100:00100000:3.0:1789126808.747415:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789126808.747427:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276698496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126808.747456:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126808.747505:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276698496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126808.747513:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789126808.747558:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa81680 x1876035276698496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126808.747575:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276698496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789126808.747642:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126808.747888:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126808.747899:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276698624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126808.747946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126808.748124:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698624 00000100:00100000:2.0:1789126808.748129:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698624 00000100:00100000:2.0:1789126808.748170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789126808.748192:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276698624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126808.748205:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126808.748244:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276698624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126808.748250:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789126808.748279:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104101a40 x1876035276698624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126808.748293:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276698624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789126808.748348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126808.845636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126808.845760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816384 00000100:00100000:1.0:1789126808.845781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816384 00000100:00100000:1.0:1789126808.845840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:1.0:1789126808.845860:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:6161:x1876035258816384:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126808.845879:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126808.845899:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c297 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.845929:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.845939:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126808.845967:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589a00, rc 0) 00000100:00100000:1.0:1789126808.846030:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816384:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.846054:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:0.0:1789126808.864273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126808.864752:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816512 00000100:00100000:1.0:1789126808.864762:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816512 00000100:00100000:1.0:1789126808.864819:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:1.0:1789126808.864828:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816512:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126808.864993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816512:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 165us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.865001:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:2.0:1789126808.869143:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126808.869417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816640 00000100:00100000:3.0:1789126808.869427:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816640 00000100:00100000:3.0:1789126808.869483:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:3.0:1789126808.869493:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816640:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126808.869779:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6161:x1876035258816640:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 287us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126808.869788:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:3.0:1789126808.873233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126808.873533:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816768 00000100:00100000:2.0:1789126808.873543:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816768 00000100:00100000:2.0:1789126808.873685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 250 00000100:00100000:2.0:1789126808.873697:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6693:x1876035258816768:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789126808.873840:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6693:x1876035258816768:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 145us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126808.873861:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 250 00000100:00100000:2.0:1789126808.899145:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126808.899887:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258816896 00000100:00100000:1.0:1789126808.899898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258816896 00000100:00100000:1.0:1789126808.899953:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:1.0:1789126808.899962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6693:x1876035258816896:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789126808.900705:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:6693:x1876035258816896:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 741us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126808.900715:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 251 00010000:00010000:0.0:1789126809.005013:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789126809.389860:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126809.389869:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 4 10000000:01000000:1.0:1789126809.389875:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126809.389925:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.389937:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.389973:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.389998:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276698752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.390064:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.390134:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789126809.390247:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698752 00000100:00100000:3.0:1789126809.390256:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698752 00000100:00100000:3.0:1789126809.390309:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789126809.390319:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276698752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126809.390339:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126809.390352:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa1d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126809.390373:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126809.390385:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126809.390393:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ea00, rc 0) 00000100:00100000:3.0:1789126809.390440:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276698752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126809.390447:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789126809.391564:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276698752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126809.391591:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.391603:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.391719:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276698880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.391766:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.391811:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126809.391831:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276698880 00000100:00100000:0.0:1789126809.391836:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276698880 00000100:00100000:0.0:1789126809.391887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789126809.391896:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276698880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126809.392030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276698880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126809.392037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789126809.392180:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276698880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126809.392213:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104103480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126809.392254:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126809.392293:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63600 going to sleep for 11 seconds 00000100:00100000:0.0:1789126809.394586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699008 00000100:00100000:0.0:1789126809.394596:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699008 00000100:00100000:0.0:1789126809.394672:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789126809.394683:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276699008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126809.394832:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276699008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126809.394839:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789126809.396974:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104103480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126809.398072:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10439:1876035276699136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126809.398144:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126809.398180:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520540 going to sleep for 11 seconds 00000100:00100000:0.0:1789126809.398303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699136 00000100:00100000:0.0:1789126809.398309:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699136 00000100:00100000:0.0:1789126809.398355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789126809.398364:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:10439:x1876035276699136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126809.398496:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:10439:x1876035276699136:12345-0@lo:502:llog_process_th.0 Request processed in 133us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126809.398504:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789126809.398913:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10439:1876035276699136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126809.398942:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789126809.398951:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126809.398959:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789126809.398967:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994102d1e800 00000020:00000080:2.0:1789126809.398969:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789126809.399033:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10439:1876035276699264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126809.399072:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126809.399098:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699264 00000100:00100000:2.0:1789126809.399101:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699264 00000100:00100000:2.0:1789126809.399129:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789126809.399138:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:10439:x1876035276699264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126809.399214:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:10439:x1876035276699264:12345-0@lo:502:llog_process_th.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126809.399221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789126809.399257:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63300 going to sleep for 11 seconds 00000100:00100000:2.0:1789126809.399270:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10439:1876035276699264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126809.399289:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126809.399294:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126809.399296:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789126809.399299:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789126809.399357:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789126809.399380:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126809.399390:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.399401:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126809.399411:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126809.399414:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 4 10000000:01000000:2.0:1789126809.399416:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126809.399446:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.399454:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.399462:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126809.399491:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126809.399518:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126809.399531:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63300 going to sleep for 11 seconds 00000100:00100000:2.0:1789126809.399543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699392 00000100:00100000:2.0:1789126809.399546:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699392 00000100:00100000:2.0:1789126809.399562:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789126809.399568:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276699392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126809.399576:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126809.399588:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa2b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.401567:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.401585:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.401595:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:2.0:1789126809.402099:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276699392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2528us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126809.402108:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789126809.402178:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126809.402197:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126809.402207:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126809.402316:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126809.402360:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.403119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699520 00000100:00100000:1.0:1789126809.403127:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699520 00000100:00100000:2.0:1789126809.403147:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.403172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789126809.403180:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276699520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.403305:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276699520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.403313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789126809.403348:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.403449:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.403492:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.403505:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.403520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699648 00000100:00100000:1.0:1789126809.403523:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699648 00000100:00100000:1.0:1789126809.403540:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789126809.403546:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276699648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.403618:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276699648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.403627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789126809.403688:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276699648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.405271:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10443:1876035276699776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.405583:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.405684:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126809.405794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699776 00000100:00100000:2.0:1789126809.405802:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699776 00000100:00100000:2.0:1789126809.406967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789126809.406981:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:10443:x1876035276699776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126809.407120:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:10443:x1876035276699776:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126809.407129:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789126809.407221:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10443:1876035276699776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126809.407251:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126809.407261:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126809.407263:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789126809.407270:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994220b43000 00000020:00000080:1.0:1789126809.407273:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126809.408246:0:10443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10443:1876035276699904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.408321:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.408357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276699904 00000100:00100000:1.0:1789126809.408363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276699904 00000100:00100000:1.0:1789126809.408398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789126809.408406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10443:x1876035276699904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.408491:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:10443:x1876035276699904:12345-0@lo:502:llog_process_th.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.408504:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789126809.408538:0:10443:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.408554:0:10443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10443:1876035276699904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126809.408575:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126809.408580:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126809.408582:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789126809.408586:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789126809.408643:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789126809.408688:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126809.408698:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408708:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126809.408717:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126809.408720:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 4 10000000:01000000:1.0:1789126809.408722:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126809.408746:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408754:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408763:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.408776:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.408807:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.408854:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.408868:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700032 00000100:00100000:1.0:1789126809.408872:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700032 00000100:00100000:1.0:1789126809.408904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789126809.408910:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276700032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126809.408918:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126809.408929:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa39 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408948:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408957:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.408965:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589e00, rc 0) 00000100:00100000:1.0:1789126809.408992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.408999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789126809.411349:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126809.411376:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.411389:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.411467:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.411523:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.411574:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70300 going to sleep for 11 seconds 00000100:00100000:3.0:1789126809.412168:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700160 00000100:00100000:3.0:1789126809.412176:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700160 00000100:00100000:3.0:1789126809.412230:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789126809.412240:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126809.412380:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126809.412388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789126809.412420:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.412465:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.412511:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.412539:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.412555:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700288 00000100:00100000:1.0:1789126809.412558:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700288 00000100:00100000:1.0:1789126809.412587:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789126809.412594:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.412707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.412714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789126809.412755:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.417040:0:10445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10445:1876035276700416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.417126:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.417178:0:10445:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70300 going to sleep for 11 seconds 00000100:00100000:3.0:1789126809.422439:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700416 00000100:00100000:3.0:1789126809.422454:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700416 00000100:00100000:3.0:1789126809.423451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789126809.423467:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:10445:x1876035276700416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126809.424707:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:10445:x1876035276700416:12345-0@lo:502:llog_process_th.0 Request processed in 1240us (7576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126809.424718:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789126809.426548:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126809.426580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126809.426600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126809.426634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126809.426689:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817152 00000100:00100000:1.0:1789126809.426697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817152 00000100:00100000:1.0:1789126809.426750:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817024 00000100:00100000:1.0:1789126809.426752:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817024 00000100:00100000:1.0:1789126809.426776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1789126809.426784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258817152:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126809.426867:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258817152:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.426874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1789126809.426890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:1.0:1789126809.426897:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258817024:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126809.426920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258817024:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.426925:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:1.0:1789126809.426942:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817408 00000100:00100000:1.0:1789126809.426945:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817408 00000100:00100000:1.0:1789126809.427309:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817280 00000100:00100000:1.0:1789126809.427313:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817280 00000100:00100000:1.0:1789126809.427340:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789126809.427348:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258817408:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126809.427388:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258817408:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.427395:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789126809.427407:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789126809.427414:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258817280:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126809.427437:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258817280:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.427443:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00080000:1.0:1789126809.427462:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126809.427466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126809.427468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126809.427477:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126809.427544:0:10445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10445:1876035276700416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126809.427580:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126809.427589:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126809.427591:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789126809.427597:0:10445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99423d256000 00000020:00000080:1.0:1789126809.427599:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126809.428104:0:10445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10445:1876035276700544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.428160:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.428191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700544 00000100:00100000:1.0:1789126809.428195:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700544 00000100:00100000:1.0:1789126809.428224:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789126809.428231:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:10445:x1876035276700544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.428329:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:10445:x1876035276700544:12345-0@lo:502:llog_process_th.0 Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.428335:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789126809.428379:0:10445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0cea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.428392:0:10445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10445:1876035276700544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126809.428411:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126809.428416:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126809.428418:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789126809.428421:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789126809.428482:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789126809.428498:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126809.428508:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.428588:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126809.428604:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126809.428607:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 4 10000000:01000000:1.0:1789126809.428609:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126809.428634:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.428642:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.428672:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.428686:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.428982:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.428999:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.429014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700672 00000100:00100000:1.0:1789126809.429018:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700672 00000100:00100000:1.0:1789126809.429042:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789126809.429049:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276700672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126809.429059:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126809.429071:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa47 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.429092:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.429102:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.429121:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166b400, rc 0) 00000100:00100000:1.0:1789126809.429153:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276700672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.429159:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789126809.429192:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126809.429204:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126809.429212:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126809.429260:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.429287:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.429300:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.429310:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700800 00000100:00100000:1.0:1789126809.429313:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700800 00000100:00100000:1.0:1789126809.429334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789126809.429340:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276700800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.429884:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276700800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 542us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.429892:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789126809.429928:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.429956:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.429997:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126809.430026:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.430037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276700928 00000100:00100000:1.0:1789126809.430041:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276700928 00000100:00100000:1.0:1789126809.430065:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789126809.430071:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276700928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126809.430140:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276700928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.430147:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789126809.430186:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276700928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126809.439922:0:10448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10448:1876035276701056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126809.440007:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126809.440050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701056 00000100:00100000:0.0:1789126809.440057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701056 00000100:00100000:0.0:1789126809.440101:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789126809.440112:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:10448:x1876035276701056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126809.441306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:10448:x1876035276701056:12345-0@lo:502:llog_process_th.0 Request processed in 1190us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126809.441340:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789126809.441403:0:10448:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45780 going to sleep for 11 seconds 00000100:00100000:0.0:1789126809.441424:0:10448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10448:1876035276701056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126809.441456:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126809.441465:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126809.441468:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789126809.441474:0:10448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994212236800 00000020:00000080:0.0:1789126809.441476:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789126809.441818:0:10448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10448:1876035276701184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126809.441874:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126809.441897:0:10448:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45780 going to sleep for 11 seconds 00000100:00100000:1.0:1789126809.442186:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701184 00000100:00100000:1.0:1789126809.442193:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701184 00000100:00100000:1.0:1789126809.442271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789126809.442282:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:10448:x1876035276701184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126809.442389:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:10448:x1876035276701184:12345-0@lo:502:llog_process_th.0 Request processed in 109us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126809.442396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789126809.442465:0:10448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:10448:1876035276701184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126809.442489:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126809.442496:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126809.442498:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789126809.442502:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789126809.442579:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789126809.442600:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126809.442609:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126809.442619:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126809.777611:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276701312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126809.777696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126809.777934:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701312 00000100:00100000:3.0:1789126809.777942:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701312 00000100:00100000:3.0:1789126809.778019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789126809.778029:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276701312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126809.778064:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126809.778118:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276701312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126809.778125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789126809.778186:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276701312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789126810.028873:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126811.050826:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126811.308494:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276701440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126811.308620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.313778:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276701568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126811.313865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126811.314900:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701440 00000100:00100000:1.0:1789126811.314911:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701440 00000100:00100000:3.0:1789126811.315459:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701568 00000100:00100000:3.0:1789126811.315465:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701568 00000100:00080000:0.0:1789126811.317879:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126811.322460:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276701696:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322538:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.322584:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276702208:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.322632:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276702720:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322674:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.322700:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789126811.322707:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276702080:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.322763:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.322842:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701696 00000100:00100000:2.0:1789126811.322849:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701696 00000100:00100000:2.0:1789126811.322896:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789126811.322907:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276701696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.322964:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276701696:12345-0@lo:400:kworker.0 Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.322971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789126811.323004:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702720 00000100:00100000:2.0:1789126811.323008:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702720 00000100:00100000:2.0:1789126811.323044:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702592 00000100:00100000:2.0:1789126811.323048:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702592 00000100:00100000:2.0:1789126811.323068:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789126811.323075:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276702720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323113:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276702720:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323119:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789126811.323138:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789126811.323144:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323173:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276702592:12345-0@lo:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323179:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789126811.323197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702080 00000100:00100000:2.0:1789126811.323202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702080 00000100:00100000:2.0:1789126811.323230:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789126811.323238:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276702080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276702080:12345-0@lo:400:kworker.0 Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789126811.323315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276701824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323364:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276702336:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323402:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276702848:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323441:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789126811.323447:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276701952:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276702464:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323534:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126811.323586:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702208 00000100:00100000:2.0:1789126811.323591:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702208 00000100:00100000:2.0:1789126811.323619:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701952 00000100:00100000:2.0:1789126811.323622:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701952 00000100:00100000:2.0:1789126811.323639:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126811.323671:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276702208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323710:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276702208:12345-0@lo:400:kworker.0 Request processed in 64us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323717:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126811.323731:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789126811.323738:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276701952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323774:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276701952:12345-0@lo:400:kworker.0 Request processed in 37us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323780:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789126811.323795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276701824 00000100:00100000:2.0:1789126811.323799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276701824 00000100:00100000:2.0:1789126811.323816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702336 00000100:00100000:2.0:1789126811.323819:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702336 00000100:00100000:2.0:1789126811.323846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702848 00000100:00100000:2.0:1789126811.323849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702848 00000100:00100000:2.0:1789126811.323867:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702464 00000100:00100000:2.0:1789126811.323869:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702464 00000100:00100000:2.0:1789126811.323880:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276702976 00000100:00100000:2.0:1789126811.323883:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276702976 00000100:00100000:2.0:1789126811.323901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789126811.323909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276701824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.323943:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276701824:12345-0@lo:400:kworker.0 Request processed in 35us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.323949:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789126811.323969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789126811.323975:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276702336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276702336:12345-0@lo:400:kworker.0 Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.324010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789126811.324020:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126811.324026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276702848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276702848:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.324057:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126811.324068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789126811.324073:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276702464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276702464:12345-0@lo:400:kworker.0 Request processed in 22us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.324100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789126811.324110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789126811.324115:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276702976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324137:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276702976:12345-0@lo:400:kworker.0 Request processed in 22us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126811.324142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789126811.324159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126811.324163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126811.324166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126811.324309:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276701952:0@lo:400:kworker.0 00010000:00080000:2.0:1789126811.324323:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415b840 x1876035276702464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126811.324345:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276702464:0@lo:400:kworker.0 00010000:00080000:2.0:1789126811.324361:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415bc00 x1876035276702976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126811.324369:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324380:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276701824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324391:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276702336:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324403:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276702848:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324454:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276702080:0@lo:400:kworker.0 00010000:00080000:2.0:1789126811.324470:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104159e00 x1876035276702592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126811.324480:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324490:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276701696:0@lo:400:kworker.0 00000100:00100000:2.0:1789126811.324499:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276702208:0@lo:400:kworker.0 00010000:00080000:2.0:1789126811.324510:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415b480 x1876035276702720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126811.324519:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276702720:0@lo:400:kworker.0 00000100:00100000:1.0:1789126811.327920:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789126811.327940:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276701440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126811.327985:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126811.328753:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276701440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 818us (20188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126811.328764:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789126811.332770:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d12c0 x1876035276701440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126811.332813:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276701440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126811.332937:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789126811.332963:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276701568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126811.332986:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126811.333069:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276701568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (19206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126811.333076:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789126811.333375:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104100b40 x1876035276701568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126811.333390:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104100b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276701568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789126812.079987:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126813.103756:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126813.361480:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276703104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126813.361548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126813.361640:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703104 00000100:00100000:1.0:1789126813.361663:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703104 00000100:00100000:1.0:1789126813.361708:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789126813.361722:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276703104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789126813.361753:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789126813.366641:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276703104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4909us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126813.366682:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789126813.372864:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276703104:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789126813.668869:0:10686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789126813.867778:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276703232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126813.867853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126813.868041:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703232 00000100:00100000:1.0:1789126813.868049:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703232 00000100:00100000:1.0:1789126813.868106:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789126813.868115:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276703232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126813.868142:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126813.868189:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276703232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126813.868197:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789126813.868236:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104101680 x1876035276703232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126813.868253:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276703232:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126813.868317:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126813.868534:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276703360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126813.868560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126813.868800:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703360 00000100:00100000:0.0:1789126813.868805:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703360 00000100:00100000:0.0:1789126813.868859:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789126813.868867:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276703360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789126813.868879:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126813.868915:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276703360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126813.868922:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789126813.868947:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415b480 x1876035276703360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126813.868960:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276703360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789126813.869001:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789126814.128688:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126814.542248:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126814.542303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126814.542337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126814.542361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126814.542385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126814.542472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817664 00000100:00100000:3.0:1789126814.542483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817664 00000100:00100000:3.0:1789126814.542543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817792 00000100:00100000:3.0:1789126814.542546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817792 00000100:00100000:3.0:1789126814.542567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:3.0:1789126814.542577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258817664:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126814.542705:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258817664:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126814.542713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:3.0:1789126814.542732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1789126814.542738:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258817792:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126814.542762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258817792:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126814.542768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:2.0:1789126814.542982:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817920 00000100:00100000:2.0:1789126814.542987:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817920 00000100:00100000:2.0:1789126814.543022:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818048 00000100:00100000:2.0:1789126814.543025:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818048 00000100:00100000:2.0:1789126814.543051:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1789126814.543061:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258817920:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126814.543075:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1789126814.543086:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818048:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126814.543103:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258817920:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 43us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126814.543111:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789126814.543126:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818048:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126814.543134:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789126814.543229:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258817536 00000100:00100000:1.0:1789126814.543237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258817536 00000100:00100000:1.0:1789126814.543282:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 273 00000100:00100000:1.0:1789126814.543290:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258817536:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126814.543330:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258817536:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126814.543336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 273 00000100:00080000:0.0:1789126814.543404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126814.543408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126814.543410:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126814.543413:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126814.891177:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126814.891252:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276703488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126814.891395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126814.891705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703488 00000100:00100000:3.0:1789126814.891713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703488 00000100:00100000:3.0:1789126814.891796:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789126814.891815:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276703488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126814.891846:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126814.891895:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276703488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126814.891902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789126814.892016:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276703488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789126815.152183:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126816.170817:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126816.427056:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276703616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126816.427123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427189:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276704256:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.427199:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276703744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126816.427218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427242:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276704768:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.427250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126816.427286:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276704128:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427298:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276705280:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.427319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126816.427346:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276704640:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427369:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703616 00000100:00100000:1.0:1789126816.427377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427378:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703616 00000100:00100000:1.0:1789126816.427400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276705152:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427427:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703744 00000100:00100000:1.0:1789126816.427431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427433:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703744 00000100:00100000:0.0:1789126816.427459:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126816.427469:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276703616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126816.427472:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276704000:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.427503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789126816.427503:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126816.427524:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276704512:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.427561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427562:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276703616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126816.427573:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789126816.427580:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276705024:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427596:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126816.427608:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104312d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276703744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126816.427611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789126816.427623:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126816.427629:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789126816.427637:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276703872:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427693:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104312d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276703744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126816.427711:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789126816.427719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704256 00000100:00100000:0.0:1789126816.427747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704256 00000100:00100000:1.0:1789126816.427753:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104133840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276704384:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704640 00000100:00100000:0.0:1789126816.427774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704640 00000100:00100000:1.0:1789126816.427782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427790:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705152 00000100:00100000:0.0:1789126816.427794:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705152 00000100:00100000:1.0:1789126816.427820:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104130780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276704896:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427821:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704000 00000100:00100000:0.0:1789126816.427825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704000 00000100:00100000:0.0:1789126816.427843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704512 00000100:00100000:0.0:1789126816.427846:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704512 00000100:00100000:1.0:1789126816.427852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126816.427862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705024 00000100:00100000:0.0:1789126816.427866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705024 00000100:00100000:2.0:1789126816.427887:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704128 00000100:00100000:1.0:1789126816.427891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704384 00000100:00100000:0.0:1789126816.427891:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789126816.427894:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704128 00000100:00100000:1.0:1789126816.427897:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704384 00000100:00100000:0.0:1789126816.427903:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276704256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126816.427936:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789126816.427944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789126816.427948:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276704128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276704256:12345-0@lo:400:kworker.0 Request processed in 48us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126816.427959:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276704384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.427966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789126816.427983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789126816.427993:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276704640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126816.428000:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276704128:12345-0@lo:400:kworker.0 Request processed in 55us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428008:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789126816.428031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276704384:12345-0@lo:400:kworker.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428039:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704768 00000100:00100000:0.0:1789126816.428039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276704640:12345-0@lo:400:kworker.0 Request processed in 46us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126816.428045:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789126816.428046:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704768 00000100:00100000:0.0:1789126816.428051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789126816.428072:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789126816.428082:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705280 00000100:00100000:0.0:1789126816.428084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276705152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789126816.428086:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705280 00000100:00100000:1.0:1789126816.428100:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276704000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126816.428120:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276704896 00000100:00100000:0.0:1789126816.428124:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276705152:12345-0@lo:400:kworker.0 Request processed in 44us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428125:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276704896 00000100:00100000:0.0:1789126816.428135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789126816.428147:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276704000:12345-0@lo:400:kworker.0 Request processed in 48us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428148:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789126816.428162:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789126816.428163:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276704768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789126816.428183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276704512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789126816.428199:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276705024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126816.428201:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276704768:12345-0@lo:400:kworker.0 Request processed in 44us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428212:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789126816.428229:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789126816.428233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276704512:12345-0@lo:400:kworker.0 Request processed in 52us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428239:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276705280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789126816.428250:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276705024:12345-0@lo:400:kworker.0 Request processed in 52us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126816.428260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789126816.428281:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789126816.428283:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276705280:12345-0@lo:400:kworker.0 Request processed in 46us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126816.428296:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789126816.428296:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276704896:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789126816.428316:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d1a40 x1876035276703744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126816.428334:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276704896:12345-0@lo:400:kworker.0 Request processed in 44us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126816.428338:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276703744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126816.428344:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789126816.428361:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276704128:0@lo:400:kworker.0 00000100:00080000:0.0:1789126816.428373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126816.428375:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104131680 x1876035276704640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789126816.428379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789126816.428383:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126816.428386:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789126816.428392:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104131680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276704640:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428401:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276703872 00010000:00080000:1.0:1789126816.428406:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043103c0 x1876035276705152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126816.428407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276703872 00000100:00100000:1.0:1789126816.428418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276705152:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789126816.428458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276703872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428468:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104133840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276704384:0@lo:400:kworker.0 00010000:00080000:1.0:1789126816.428482:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104130780 x1876035276704896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126816.428491:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104130780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276704896:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428496:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276703872:12345-0@lo:400:kworker.0 Request processed in 38us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126816.428505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789126816.428509:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276704000:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428522:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276704512:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428534:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276705024:0@lo:400:kworker.0 00000100:00100000:0.0:1789126816.428552:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276704256:0@lo:400:kworker.0 00000100:00100000:1.0:1789126816.428563:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276703872:0@lo:400:kworker.0 00010000:00080000:0.0:1789126816.428573:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104132d00 x1876035276704768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126816.428585:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276704768:0@lo:400:kworker.0 00010000:00080000:0.0:1789126816.428599:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104310f00 x1876035276705280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126816.428616:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276705280:0@lo:400:kworker.0 00010000:00080000:0.0:1789126816.428630:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104158b40 x1876035276703616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126816.428643:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276703616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789126817.206067:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789126817.506774:0:10929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing yml_node 00010000:00010000:0.0:1789126818.219838:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126818.474859:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126818.474883:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9942366252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276705408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126818.474950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126818.477906:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705408 00000100:00100000:2.0:1789126818.477920:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705408 00000100:00100000:2.0:1789126818.477978:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789126818.477988:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276705408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126818.478022:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126818.478105:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276705408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126818.478112:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789126818.478233:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9942366252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276705408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126818.987035:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126818.987058:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276705536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126818.987131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126818.987373:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705536 00000100:00100000:0.0:1789126818.987382:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705536 00000100:00100000:0.0:1789126818.987453:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126818.987464:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276705536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789126818.987492:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126818.987540:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276705536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126818.987548:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789126818.987608:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789126818.987678:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410415a940 x1876035276705536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126818.987697:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276705536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126818.988755:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276705664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126818.988807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126818.989045:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705664 00000100:00100000:2.0:1789126818.989050:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705664 00000100:00100000:2.0:1789126818.989147:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789126818.989156:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276705664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126818.989171:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789126818.989296:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126818.989384:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276705664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126818.989391:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789126818.990085:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236627480 x1876035276705664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126818.990104:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276705664:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789126819.242963:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126819.667416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126819.667470:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126819.667714:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818176 00000100:00100000:2.0:1789126819.667728:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818176 00000100:00100000:2.0:1789126819.667814:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 275 00000100:00100000:2.0:1789126819.667824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2391:x1876035258818176:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126819.667904:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2391:x1876035258818176:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 82us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126819.667911:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 275 00000100:00100000:0.0:1789126819.668234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818304 00000100:00100000:0.0:1789126819.668240:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818304 00000100:00100000:0.0:1789126819.668293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1789126819.668301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258818304:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126819.668337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258818304:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126819.668343:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00080000:2.0:1789126819.668448:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126819.689534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126819.689852:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818432 00000100:00100000:1.0:1789126819.689865:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818432 00000100:00100000:1.0:1789126819.689962:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:1.0:1789126819.689984:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258818432:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126819.690084:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258818432:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 102us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126819.690092:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00080000:2.0:1789126819.690169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126819.692614:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126819.692707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126819.692799:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818560 00000100:00100000:2.0:1789126819.692808:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818560 00000100:00100000:2.0:1789126819.692880:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818688 00000100:00100000:2.0:1789126819.692883:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818688 00000100:00100000:2.0:1789126819.692916:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789126819.692926:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818560:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126819.692987:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818560:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126819.693000:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789126819.693015:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1789126819.693021:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818688:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126819.693042:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258818688:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126819.693047:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00080000:3.0:1789126819.693240:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126819.693244:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126820.011269:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276705792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126820.011342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126820.011478:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705792 00000100:00100000:3.0:1789126820.011485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705792 00000100:00100000:3.0:1789126820.011544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789126820.011554:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276705792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126820.011586:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126820.011641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276705792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126820.011671:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789126820.011811:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276705792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789126820.266990:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126821.290873:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126821.546957:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126821.546978:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276705920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126821.547044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.547108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276705920 00000100:00100000:3.0:1789126821.547116:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276705920 00000100:00100000:3.0:1789126821.547166:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789126821.547175:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276705920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126821.547203:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126821.547247:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276705920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126821.547253:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789126821.547273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789126821.547301:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236680b40 x1876035276705920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126821.547327:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276705920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126821.548121:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276706176:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276706048:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.548173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548248:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276706560:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548297:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276707072:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548337:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276707584:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548378:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789126821.548385:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276706432:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548424:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276706944:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548456:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276707456:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126821.548497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706048 00000100:00100000:3.0:1789126821.548502:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706048 00000100:00100000:3.0:1789126821.548535:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789126821.548542:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276706048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276706048:12345-0@lo:400:kworker.0 Request processed in 38us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126821.548586:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789126821.548621:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707072 00000100:00100000:3.0:1789126821.548624:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707072 00000100:00100000:3.0:1789126821.548669:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707584 00000100:00100000:3.0:1789126821.548672:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707584 00000100:00100000:3.0:1789126821.548690:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789126821.548695:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276707072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548735:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276707072:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126821.548740:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789126821.548751:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789126821.548756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236683840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276707584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548791:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236683840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276707584:12345-0@lo:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126821.548796:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789126821.548814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706432 00000100:00100000:3.0:1789126821.548817:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706432 00000100:00100000:3.0:1789126821.548838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789126821.548844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276706432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.548871:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276706432:12345-0@lo:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126821.548877:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789126821.548984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706176 00000100:00100000:1.0:1789126821.548988:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706176 00000100:00100000:1.0:1789126821.549011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706560 00000100:00100000:1.0:1789126821.549013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706560 00000100:00100000:1.0:1789126821.549025:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706944 00000100:00100000:1.0:1789126821.549028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706944 00000100:00100000:1.0:1789126821.549041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707456 00000100:00100000:1.0:1789126821.549043:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707456 00000100:00100000:1.0:1789126821.549056:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126821.549062:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276706176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126821.549102:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276706176:12345-0@lo:400:kworker.0 Request processed in 40us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126821.549108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126821.549122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789126821.549127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276706560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126821.549151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276706560:12345-0@lo:400:kworker.0 Request processed in 24us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126821.549157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789126821.549168:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789126821.549174:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276706944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126821.549199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276706944:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126821.549204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789126821.549223:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789126821.549228:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276707456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126821.549253:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276707456:12345-0@lo:400:kworker.0 Request processed in 26us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126821.549257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789126821.549385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126821.549390:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126821.549393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126821.549423:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276706432:0@lo:400:kworker.0 00010000:00080000:3.0:1789126821.549435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030ded00 x1876035276706944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126821.549457:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276706944:0@lo:400:kworker.0 00010000:00080000:3.0:1789126821.549467:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df0c0 x1876035276707456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126821.549474:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276707456:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.549483:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276706048:0@lo:400:kworker.0 00000100:00100000:3.0:1789126821.549492:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276706560:0@lo:400:kworker.0 00010000:00080000:3.0:1789126821.549501:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030dd2c0 x1876035276707072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126821.549509:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276707072:0@lo:400:kworker.0 00010000:00080000:3.0:1789126821.549518:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030dda40 x1876035276707584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126821.549525:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276707584:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.552744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276706176:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.552770:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276706688:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.553222:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126821.553816:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276707200:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.553968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126821.554015:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789126821.554024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276706304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126821.554056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126821.554076:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276706816:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.554111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126821.554128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276707328:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.554146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126821.554181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706816 00000100:00100000:0.0:1789126821.554186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706816 00000100:00100000:0.0:1789126821.554232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707328 00000100:00100000:0.0:1789126821.554234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707328 00000100:00100000:0.0:1789126821.554252:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789126821.554261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276706816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.555257:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276706816:12345-0@lo:400:kworker.0 Request processed in 995us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126821.555268:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789126821.555406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789126821.555416:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276707328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.555454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276707328:12345-0@lo:400:kworker.0 Request processed in 41us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126821.555513:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706688 00000100:00100000:2.0:1789126821.555520:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706688 00000100:00100000:2.0:1789126821.555559:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789126821.555566:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276706688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126821.555603:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276706688:12345-0@lo:400:kworker.0 Request processed in 38us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126821.555610:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789126821.555683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789126821.555701:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276706304 00000100:00100000:2.0:1789126821.555705:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276706304 00000100:00080000:0.0:1789126821.555725:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126821.555743:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789126821.555751:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276706304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789126821.555777:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126821.555783:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276706816:0@lo:400:kworker.0 00000100:00100000:0.0:1789126821.555801:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276707328:0@lo:400:kworker.0 00000100:00100000:2.0:1789126821.555814:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276706304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126821.555821:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126821.555826:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276706688:0@lo:400:kworker.0 00000100:00100000:2.0:1789126821.555840:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707200 00000100:00100000:2.0:1789126821.555845:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707200 00000100:00100000:2.0:1789126821.555881:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789126821.556006:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276707200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126821.556045:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276707200:12345-0@lo:400:kworker.0 Request processed in 41us (2077us total) trans 0 rc 0/0 00010000:00080000:0.0:1789126821.556050:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104312940 x1876035276706304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126821.556053:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126821.556072:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276706304:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789126821.556620:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df480 x1876035276707200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126821.556632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276707200:0@lo:400:kworker.0 00000100:00080000:0.0:1789126821.556693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789126821.619686:0:11113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.137 00010000:00010000:0.0:1789126822.319013:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126823.338898:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126823.599076:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126823.599109:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276707712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126823.599197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126823.600163:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707712 00000100:00100000:3.0:1789126823.600175:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707712 00000100:00100000:3.0:1789126823.600243:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789126823.600255:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276707712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126823.600302:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126823.600394:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276707712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126823.600402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789126823.600461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276707712:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789126824.065971:0:11210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.137 00000100:00100000:1.0:1789126824.107468:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276707840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126824.107558:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126824.107946:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126824.107967:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276707968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126824.108009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126824.108051:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707840 00000100:00100000:3.0:1789126824.108061:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707840 00000100:00100000:3.0:1789126824.108125:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276707968 00000100:00100000:3.0:1789126824.108385:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276707968 00000100:00100000:3.0:1789126824.108418:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789126824.108429:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276707840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126824.108469:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126824.112397:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276707840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3952us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126824.112419:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789126824.112477:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789126824.112500:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276707968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126824.112538:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126824.112642:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276707968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (4631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126824.112671:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789126824.112708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789126824.112852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236680f00 x1876035276707968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126824.112954:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276707968:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789126824.114901:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236624b40 x1876035276707840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126824.114936:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276707840:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789126824.363142:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126824.782127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126824.782165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126824.782214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126824.782251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819072 00000100:00100000:2.0:1789126824.782261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819072 00000100:00100000:3.0:1789126824.782272:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818944 00000100:00100000:3.0:1789126824.782291:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818944 00000100:00100000:2.0:1789126824.782337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:2.0:1789126824.782350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258819072:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126824.782356:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00080000:0.0:1789126824.782362:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789126824.782367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126824.782369:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258818944:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126824.782425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258819072:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126824.782426:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258818944:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126824.782436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258818816 00000100:00100000:2.0:1789126824.782440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1789126824.782442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258818816 00000100:00100000:3.0:1789126824.782446:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:1.0:1789126824.782477:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 277 00000100:00100000:1.0:1789126824.782485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258818816:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126824.782526:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258818816:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 43us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126824.782533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 277 00000100:00100000:3.0:1789126824.792981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126824.793025:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126824.793221:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819200 00000100:00100000:1.0:1789126824.793231:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819200 00000100:00080000:3.0:1789126824.793294:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126824.793302:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819328 00000100:00100000:1.0:1789126824.793307:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819328 00000100:00100000:2.0:1789126824.793351:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1789126824.793358:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1789126824.793362:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258819200:12345-192.168.203.23@tcp:9:kworker.0 00000100:00100000:1.0:1789126824.793363:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258819328:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:2.0:1789126824.793395:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea960 00000100:00080000:2.0:1789126824.793405:0:8429:0:(import.c:65:import_set_state_nolock()) ffff99410407f800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789126824.793407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1789126824.793450:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000080:1.0:1789126824.793544:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea967 00000100:00080000:1.0:1789126824.793552:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9941031ec000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789126824.793586:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789126824.793604:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+2:2390:x1876035258819200:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 243us (632us total) trans 0 rc 0/0 00010000:00010000:3.0:1789126824.793615:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126824.793625:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00010000:00010000:2.0:1789126824.793695:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126824.794314:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+2:2390:x1876035258819328:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 947us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126824.794322:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1789126825.131110:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9942366812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276708096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126825.131221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126825.132411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708096 00000100:00100000:2.0:1789126825.132426:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708096 00000100:00100000:2.0:1789126825.132508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789126825.132520:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276708096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126825.132570:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789126825.136027:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276708096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3495us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126825.136047:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789126825.138829:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9942366812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276708096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789126825.386959:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126826.420377:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126826.667558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276708224:0@lo:400:kworker.0 00000100:00100000:0.0:1789126826.667694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126826.667767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276708736:0@lo:400:kworker.0 00000100:00100000:0.0:1789126826.667798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126826.667821:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276709248:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668017:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276708608:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668079:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276709120:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668126:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276709632:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668179:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789126826.668186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276708480:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668232:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276708992:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668273:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276709504:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668343:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276708352:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668395:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276708864:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668429:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276709376:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668459:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276709888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126826.668483:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.668523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708608 00000100:00100000:1.0:1789126826.668533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708608 00000100:00100000:1.0:1789126826.668585:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708992 00000100:00100000:1.0:1789126826.668588:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708992 00000100:00100000:1.0:1789126826.668614:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709504 00000100:00100000:1.0:1789126826.668617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709504 00000100:00100000:1.0:1789126826.668631:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708352 00000100:00100000:1.0:1789126826.668634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708352 00000100:00100000:1.0:1789126826.668644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708864 00000100:00100000:1.0:1789126826.668672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708864 00000100:00100000:1.0:1789126826.668688:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709376 00000100:00100000:1.0:1789126826.668690:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709376 00000100:00100000:1.0:1789126826.668708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789126826.668717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104312940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276708608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104312940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276708608:12345-0@lo:400:kworker.0 Request processed in 71us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.668796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789126826.668820:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789126826.668833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276708992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668870:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276708992:12345-0@lo:400:kworker.0 Request processed in 44us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.668876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789126826.668887:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789126826.668892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104133840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276709504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668915:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104133840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276709504:12345-0@lo:400:kworker.0 Request processed in 23us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.668921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789126826.668931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126826.668936:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276708352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.668969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276708352:12345-0@lo:400:kworker.0 Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.668975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126826.668988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789126826.668994:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276708864:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669025:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789126826.669036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789126826.669042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276709376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669071:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276709376:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669078:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789126826.669100:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709120 00000100:00100000:1.0:1789126826.669104:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709120 00000100:00100000:1.0:1789126826.669144:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709632 00000100:00100000:1.0:1789126826.669148:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709632 00000100:00100000:1.0:1789126826.669169:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789126826.669175:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276709120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669210:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276709120:12345-0@lo:400:kworker.0 Request processed in 36us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669216:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789126826.669227:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789126826.669232:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276709632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669257:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276709632:12345-0@lo:400:kworker.0 Request processed in 25us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669262:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789126826.669295:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709888 00000100:00100000:1.0:1789126826.669299:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709888 00000100:00100000:1.0:1789126826.669328:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789126826.669334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276709888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126826.669364:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126826.669397:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276709888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669404:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789126826.669457:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276708352:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669471:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276708864:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669483:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276709376:0@lo:400:kworker.0 00010000:00080000:1.0:1789126826.669497:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104310b40 x1876035276709888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126826.669530:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276709888:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789126826.669586:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276708992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126826.669596:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276708992:0@lo:400:kworker.0 00010000:00080000:1.0:1789126826.669607:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104304000 x1876035276709504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126826.669614:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276709504:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669625:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276708608:0@lo:400:kworker.0 00010000:00080000:1.0:1789126826.669637:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee3840 x1876035276709120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126826.669670:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276709120:0@lo:400:kworker.0 00010000:00080000:1.0:1789126826.669683:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043061c0 x1876035276709632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126826.669692:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276709632:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669756:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708736 00000100:00100000:1.0:1789126826.669761:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708736 00000100:00100000:1.0:1789126826.669797:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708480 00000100:00100000:1.0:1789126826.669801:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708480 00000100:00100000:1.0:1789126826.669814:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789126826.669822:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276708736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669862:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276708736:12345-0@lo:400:kworker.0 Request processed in 42us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669879:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789126826.669892:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126826.669897:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276708480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.669932:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276708480:12345-0@lo:400:kworker.0 Request processed in 35us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.669939:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126826.669959:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276708224 00000100:00100000:1.0:1789126826.669964:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276708224 00000100:00100000:1.0:1789126826.669992:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789126826.669999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276708224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.670034:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276708224:12345-0@lo:400:kworker.0 Request processed in 35us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.670041:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789126826.670086:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276708480:0@lo:400:kworker.0 00000100:00080000:1.0:1789126826.670168:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126826.670174:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126826.670178:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126826.670180:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126826.674439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.674502:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276709760:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.674550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126826.674613:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276708224:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.674633:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276708736:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.674715:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709248 00000100:00100000:1.0:1789126826.674724:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709248 00000100:00100000:1.0:1789126826.674817:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276709760 00000100:00100000:1.0:1789126826.674821:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276709760 00000100:00100000:0.0:1789126826.675248:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126826.675264:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276710016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126826.675312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126826.675356:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710016 00000100:00100000:0.0:1789126826.675361:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710016 00000100:00100000:0.0:1789126826.675399:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789126826.675410:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276710016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126826.675444:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126826.675494:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276710016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126826.675504:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789126826.675550:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104306580 x1876035276710016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126826.675570:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276710016:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789126826.675617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126826.675634:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126826.675643:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276709248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126826.675707:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276709248:12345-0@lo:400:kworker.0 Request processed in 66us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126826.675714:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789126826.675764:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104307480 x1876035276709248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126826.675777:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276709248:0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.681344:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789126826.681365:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276709760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126826.681504:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276709760:12345-0@lo:400:kworker.0 Request processed in 144us (6953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126826.681513:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789126826.681701:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104304b40 x1876035276709760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126826.681721:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276709760:0@lo:400:kworker.0 00000001:02000400:3.0:1789126826.950506:0:11308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.137 00010000:00010000:3.0:1789126827.434931:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126828.458774:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126828.718778:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126828.718812:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276710144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126828.718920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126828.719240:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710144 00000100:00100000:3.0:1789126828.719250:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710144 00000100:00100000:3.0:1789126828.719318:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789126828.719329:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276710144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126828.719373:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126828.719431:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276710144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126828.719438:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789126828.719587:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276710144:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789126828.849022:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 07:40:26 EDT 2026 00000100:00100000:1.0:1789126829.227284:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276710272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126829.227394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126829.227507:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710272 00000100:00100000:1.0:1789126829.227516:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710272 00000100:00100000:1.0:1789126829.228123:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789126829.228141:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276710272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126829.228185:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126829.228493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126829.228510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276710400:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789126829.228692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126829.236690:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126829.239898:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789126829.239927:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789126829.240642:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710400 00000100:00100000:0.0:1789126829.240699:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710400 00000100:00100000:2.0:1789126829.241145:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789126829.241159:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276710400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126829.241194:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126829.241334:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276710400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (4663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126829.241343:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789126829.241486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789126829.241586:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236681a40 x1876035276710400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126829.241624:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276710400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126829.245552:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276710272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17403us (18144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126829.245573:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789126829.245958:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236680f00 x1876035276710272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126829.245995:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276710272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789126829.482956:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126829.904556:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126829.904622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126829.904679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126829.904842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819584 00000100:00100000:1.0:1789126829.904855:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819584 00000100:00080000:3.0:1789126829.905011:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126829.905971:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819712 00000100:00100000:1.0:1789126829.905980:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819712 00000100:00100000:0.0:1789126829.906003:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:0.0:1789126829.906019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258819584:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126829.906118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1789126829.906130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258819712:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126829.906132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258819584:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 116us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126829.906143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:1.0:1789126829.906181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258819712:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 53us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126829.906190:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819456 00000100:00100000:0.0:1789126829.906196:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819456 00000100:00100000:1.0:1789126829.906204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:0.0:1789126829.906231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 279 00000100:00100000:0.0:1789126829.906239:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258819456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126829.906270:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258819456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126829.906278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 279 00000100:00080000:3.0:1789126829.906461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126830.252839:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276710528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126830.252911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126830.253949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710528 00000100:00100000:3.0:1789126830.253958:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710528 00000100:00100000:3.0:1789126830.254041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789126830.254052:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276710528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126830.254086:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126830.254151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276710528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126830.254160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789126830.254193:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276710528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789126830.508727:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789126830.765409:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:2.0:1789126830.765417:0:8422:0:(genops.c:885:class_export_put()) final put ffff994104078800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000001:00100000:3.0:1789126830.766019:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:3.0:1789126830.766025:0:9505:0:(genops.c:885:class_export_put()) final put ffff9941031ee000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:1.0:1789126830.767362:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994104078800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-OST0000 00000020:00000080:1.0:1789126830.767410:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99410407f800 for lustre-OST0000 00000020:00000080:1.0:1789126830.774606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031ee000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-OST0001 00000020:00000080:1.0:1789126830.774678:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941031ec000 for lustre-OST0001 00010000:00010000:3.0:1789126831.531796:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126831.788771:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276710656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126831.788846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126831.788957:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710656 00000100:00100000:1.0:1789126831.788964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710656 00000100:00100000:1.0:1789126831.789018:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789126831.789039:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276710656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126831.789068:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126831.789112:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276710656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126831.789120:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789126831.789225:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789126831.789254:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d3c00 x1876035276710656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.789272:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276710656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126831.790176:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236683840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276710784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126831.790218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790629:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276710912:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790727:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276711424:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790768:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276711936:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790809:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789126831.790814:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276711296:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790852:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276711808:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.790898:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711424 00000100:00100000:3.0:1789126831.790904:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711424 00000100:00100000:3.0:1789126831.790943:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789126831.790950:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276711424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.790995:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276711424:12345-0@lo:400:kworker.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791002:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789126831.791025:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711936 00000100:00100000:3.0:1789126831.791040:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711936 00000100:00100000:3.0:1789126831.791071:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711808 00000100:00100000:3.0:1789126831.791074:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711808 00000100:00100000:3.0:1789126831.791094:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789126831.791101:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276711936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791131:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276711936:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791137:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789126831.791157:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789126831.791162:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276711808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791191:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276711808:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791197:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789126831.791214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711296 00000100:00100000:3.0:1789126831.791217:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711296 00000100:00100000:3.0:1789126831.791238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789126831.791244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276711296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791269:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276711296:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789126831.791301:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126831.791319:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276711168:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791361:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276711680:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791399:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276712192:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791436:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789126831.791442:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276711040:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791476:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276711552:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276712064:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126831.791560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711168 00000100:00100000:3.0:1789126831.791564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711168 00000100:00100000:3.0:1789126831.791584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789126831.791590:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276711168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791623:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276711168:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789126831.791642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711680 00000100:00100000:3.0:1789126831.791645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711680 00000100:00100000:3.0:1789126831.791686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712192 00000100:00100000:3.0:1789126831.791689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712192 00000100:00100000:3.0:1789126831.791715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711040 00000100:00100000:3.0:1789126831.791717:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711040 00000100:00100000:3.0:1789126831.791726:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276711552 00000100:00100000:3.0:1789126831.791728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276711552 00000100:00100000:3.0:1789126831.791740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712064 00000100:00100000:3.0:1789126831.791742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712064 00000100:00100000:3.0:1789126831.791754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789126831.791760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276711680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276711680:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789126831.791808:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126831.791814:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276712192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791839:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276712192:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126831.791864:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789126831.791870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276711040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791897:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276711040:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789126831.791914:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126831.791920:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276711552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276711552:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.791951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126831.791962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126831.791968:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276712064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.791994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276712064:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126831.792000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1789126831.792020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126831.792023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126831.792051:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276711296:0@lo:400:kworker.0 00010000:00080000:3.0:1789126831.792065:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675c3c0 x1876035276711808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.792074:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276711808:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.792084:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276711424:0@lo:400:kworker.0 00010000:00080000:3.0:1789126831.792093:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675c780 x1876035276711936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.792114:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276711936:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.792147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276711040:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.792156:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276711552:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.792165:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276712064:0@lo:400:kworker.0 00000100:00100000:3.0:1789126831.792174:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276711168:0@lo:400:kworker.0 00010000:00080000:3.0:1789126831.792184:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647f480 x1876035276711680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.792192:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276711680:0@lo:400:kworker.0 00010000:00080000:3.0:1789126831.792202:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104018b40 x1876035276712192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.792210:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276712192:0@lo:400:kworker.0 00000100:00100000:1.0:1789126831.792378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710912 00000100:00100000:1.0:1789126831.792383:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710912 00000100:00100000:1.0:1789126831.792422:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789126831.792429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276710912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126831.792465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276710912:12345-0@lo:400:kworker.0 Request processed in 38us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126831.792471:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789126831.792543:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276710912:0@lo:400:kworker.0 00000100:00100000:2.0:1789126831.793705:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276710784 00000100:00100000:2.0:1789126831.793714:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276710784 00000100:00100000:2.0:1789126831.793758:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789126831.793765:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276710784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126831.793786:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126831.793843:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276710784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126831.793850:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789126831.794517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789126831.794554:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236683840 x1876035276710784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126831.794574:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236683840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276710784:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789126832.555510:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126833.592713:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126833.846835:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276712320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126833.846901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126833.847001:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712320 00000100:00100000:2.0:1789126833.847007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712320 00000100:00100000:2.0:1789126833.847051:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789126833.847060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276712320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126833.847103:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126833.847148:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276712320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126833.847155:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789126833.847192:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276712320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126834.350865:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126834.350892:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276712448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126834.350978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126834.351060:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712448 00000100:00100000:2.0:1789126834.351068:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712448 00000100:00100000:2.0:1789126834.351128:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126834.351138:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276712448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126834.351174:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126834.351215:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276712448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126834.351223:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789126834.351265:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236626580 x1876035276712448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126834.351286:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236626580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276712448:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789126834.352222:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126834.352295:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126834.352326:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276712576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126834.352384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126834.352439:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712576 00000100:00100000:3.0:1789126834.352445:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712576 00000100:00100000:3.0:1789126834.352507:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789126834.352517:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276712576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126834.352835:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126834.352898:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276712576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 381us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126834.352905:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789126834.352928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126834.353086:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030df480 x1876035276712576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126834.353115:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276712576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789126834.604083:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126835.021042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126835.021108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126835.021155:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126835.021205:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819840 00000100:00100000:3.0:1789126835.021219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819840 00000100:00100000:3.0:1789126835.021329:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00100000:3.0:1789126835.021344:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258819840:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126835.021479:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2392:x1876035258819840:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126835.021492:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00100000:3.0:1789126835.021552:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820096 00000100:00100000:3.0:1789126835.021558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820096 00000100:00100000:3.0:1789126835.021620:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258819968 00000100:00100000:3.0:1789126835.021626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258819968 00000100:00100000:3.0:1789126835.021703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:3.0:1789126835.021716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258820096:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126835.021791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258820096:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 78us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126835.021802:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:3.0:1789126835.021825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:3.0:1789126835.021837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258819968:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126835.021882:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258819968:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 45us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126835.021893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00080000:3.0:1789126835.022136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126835.022145:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126835.371926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276712704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126835.372044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126835.372193:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712704 00000100:00100000:3.0:1789126835.372204:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712704 00000100:00100000:3.0:1789126835.372322:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789126835.372337:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276712704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126835.372395:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126835.372462:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276712704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126835.372472:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789126835.372564:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276712704:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789126835.642614:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126836.652842:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126836.907211:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104103c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276713216:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.907218:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276712832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126836.907289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126836.907470:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276713728:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.907484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126836.907507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.907521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276713344:0@lo:400:kworker.0 00000100:00100000:0.0:1789126836.907534:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276714240:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.907554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.907594:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276713856:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.907615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713216 00000100:00100000:1.0:1789126836.907623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713216 00000100:00100000:2.0:1789126836.907624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.907677:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276714368:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.907702:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.907706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789126836.907718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276713216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.907731:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789126836.907740:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276712960:0@lo:400:kworker.0 00000100:00100000:0.0:1789126836.909288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713728 00000100:00100000:0.0:1789126836.909299:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713728 00000100:00100000:0.0:1789126836.909374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713344 00000100:00100000:0.0:1789126836.909378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713344 00000100:00100000:0.0:1789126836.909407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789126836.909417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276713728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126836.916750:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713856 00000100:00100000:3.0:1789126836.916771:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713856 00000100:00100000:3.0:1789126836.916842:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714368 00000100:00100000:3.0:1789126836.916845:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714368 00000100:00100000:3.0:1789126836.916870:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789126836.916882:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276713856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.917554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.917577:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276713216:12345-0@lo:400:kworker.0 Request processed in 9858us (10285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.917587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789126836.917612:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276713472:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.917692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.917712:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276713984:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.917736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.917749:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276714496:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.917769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126836.917809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713472 00000100:00100000:2.0:1789126836.917814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713472 00000100:00100000:2.0:1789126836.917839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789126836.917846:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276713472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.917891:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276713472:12345-0@lo:400:kworker.0 Request processed in 45us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126836.917897:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789126836.917919:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713984 00000100:00100000:2.0:1789126836.917922:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713984 00000100:00100000:2.0:1789126836.917941:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714496 00000100:00100000:2.0:1789126836.917943:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714496 00000100:00100000:2.0:1789126836.917961:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789126836.917968:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276714368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.918017:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276714368:12345-0@lo:400:kworker.0 Request processed in 49us (10314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126836.918025:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789126836.920684:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789126836.920705:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276713984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.920791:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276713984:12345-0@lo:400:kworker.0 Request processed in 96us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126836.920798:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789126836.920822:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789126836.920830:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276714496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.920857:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276714496:12345-0@lo:400:kworker.0 Request processed in 29us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126836.920863:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789126836.921693:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276713472:0@lo:400:kworker.0 00010000:00080000:2.0:1789126836.921711:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e099a40 x1876035276713984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126836.921724:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276713984:0@lo:400:kworker.0 00010000:00080000:2.0:1789126836.921736:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e0992c0 x1876035276714496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126836.921744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276714496:0@lo:400:kworker.0 00010000:00080000:2.0:1789126836.921757:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e098000 x1876035276714368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126836.921765:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276714368:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.924761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789126836.924895:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276713344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.924997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276713344:12345-0@lo:400:kworker.0 Request processed in 223us (17443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.925005:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789126836.925037:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126836.925041:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126836.925044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126836.925057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.925110:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104103c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276713216:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925125:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789126836.925134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104103840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276713088:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.925174:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276713600:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.925199:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276714112:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.925260:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276714624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126836.925282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126836.925309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714240 00000100:00100000:1.0:1789126836.925314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714240 00000100:00100000:1.0:1789126836.925347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713088 00000100:00100000:1.0:1789126836.925350:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713088 00000100:00100000:1.0:1789126836.925361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276713600 00000100:00100000:1.0:1789126836.925363:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276713600 00000100:00100000:1.0:1789126836.925374:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714112 00000100:00100000:1.0:1789126836.925376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714112 00000100:00100000:1.0:1789126836.925389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789126836.925395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276714240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925433:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276714240:12345-0@lo:400:kworker.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.925438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789126836.925452:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789126836.925457:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e0992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276713088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e0992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276713088:12345-0@lo:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.925492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789126836.925503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789126836.925509:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276713600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276713600:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.925545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789126836.925555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789126836.925567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276714112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.925597:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276714112:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126836.925602:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789126836.925617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126836.925619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126836.925638:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104103840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276713088:0@lo:400:kworker.0 00000100:00100000:2.0:1789126836.925797:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276713344:0@lo:400:kworker.0 00000100:00100000:0.0:1789126836.926348:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276713728:12345-0@lo:400:kworker.0 Request processed in 16930us (18839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126836.926357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789126836.931854:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712832 00000100:00100000:3.0:1789126836.931868:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712832 00000100:00100000:3.0:1789126836.931933:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714624 00000100:00100000:3.0:1789126836.931936:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714624 00000100:00100000:3.0:1789126836.931955:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789126836.931964:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276712832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126836.932009:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126836.932464:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276712832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 500us (24980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126836.932474:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789126836.932494:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789126836.932502:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276714624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126836.932513:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126836.932543:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276714624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (7259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126836.932549:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789126836.932587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276712960 00000100:00100000:3.0:1789126836.932591:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276712960 00000100:00100000:3.0:1789126836.932619:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789126836.932625:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276712960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126836.932689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276712960:12345-0@lo:400:kworker.0 Request processed in 64us (15138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126836.932696:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789126836.932759:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276712960:0@lo:400:kworker.0 00010000:00080000:3.0:1789126836.932777:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104018000 x1876035276712832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126836.932794:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276712832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126836.932837:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276713856:12345-0@lo:400:kworker.0 Request processed in 15959us (25213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126836.932852:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789126836.932880:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104132d00 x1876035276713856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126836.932889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276713856:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.934144:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276713600:0@lo:400:kworker.0 00000100:00100000:1.0:1789126836.934177:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276714112:0@lo:400:kworker.0 00010000:00080000:1.0:1789126836.934190:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043043c0 x1876035276714624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126836.934205:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276714624:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789126836.934219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104132580 x1876035276713728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126836.934228:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276713728:0@lo:400:kworker.0 00010000:00080000:1.0:1789126836.934239:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e09ad00 x1876035276714240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126836.934259:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276714240:0@lo:400:kworker.0 00010000:00010000:0.0:1789126837.679442:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126838.701253:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126838.954975:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126838.954997:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276714752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126838.955065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126838.955130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714752 00000100:00100000:2.0:1789126838.955137:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714752 00000100:00100000:2.0:1789126838.955179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789126838.955188:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276714752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126838.955222:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126838.955264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276714752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126838.955272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789126838.955311:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236626940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276714752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126839.469445:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126839.469466:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276714880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126839.469529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126839.469588:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276714880 00000100:00100000:1.0:1789126839.469595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276714880 00000100:00100000:1.0:1789126839.469703:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789126839.469713:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276714880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126839.469755:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126839.469801:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276714880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126839.469809:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789126839.469848:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126839.469891:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276715008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126839.469919:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789126839.469951:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f9e4780 x1876035276714880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126839.469969:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276714880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126839.469993:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715008 00000100:00100000:1.0:1789126839.469997:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715008 00000100:00100000:1.0:1789126839.470023:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789126839.470029:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276715008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126839.470039:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126839.470068:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276715008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126839.470075:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789126839.470088:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126839.470104:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423e0983c0 x1876035276715008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126839.470116:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276715008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789126839.723059:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126840.143231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126840.143279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126840.143304:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126840.143330:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820224 00000100:00100000:3.0:1789126840.143339:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820224 00000100:00100000:3.0:1789126840.143383:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:3.0:1789126840.143391:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2391:x1876035258820224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126840.143451:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2391:x1876035258820224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126840.143458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:0.0:1789126840.143952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820352 00000100:00100000:0.0:1789126840.143957:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820352 00000100:00100000:0.0:1789126840.144002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820480 00000100:00100000:0.0:1789126840.144006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820480 00000100:00100000:0.0:1789126840.144028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:0.0:1789126840.144036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258820352:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126840.144092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258820352:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 56us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126840.144108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:0.0:1789126840.144123:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:0.0:1789126840.144129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258820480:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126840.144157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258820480:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126840.144164:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00080000:1.0:1789126840.144327:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126840.144337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126840.493474:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276715136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126840.493618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126840.494428:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715136 00000100:00100000:3.0:1789126840.494437:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715136 00000100:00100000:3.0:1789126840.494492:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789126840.494503:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276715136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126840.494857:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126840.495383:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276715136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 880us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126840.495392:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789126840.495489:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276715136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789126840.750976:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126841.772856:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126842.026937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126842.026969:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276715264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126842.027066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126842.027146:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715264 00000100:00100000:0.0:1789126842.027156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715264 00000100:00100000:0.0:1789126842.027229:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126842.027241:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276715264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789126842.027283:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126842.027336:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276715264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126842.027344:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789126842.027369:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789126842.027404:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043070c0 x1876035276715264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126842.027440:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276715264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126842.029829:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126842.030002:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276715520:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.030090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.030132:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276715392:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.030163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.030209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715520 00000100:00100000:3.0:1789126842.030217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715520 00000100:00100000:3.0:1789126842.030276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789126842.030287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276715520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.030345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276715520:12345-0@lo:400:kworker.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.030353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789126842.031514:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715392 00000100:00100000:3.0:1789126842.031524:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715392 00000100:00100000:3.0:1789126842.031575:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789126842.031584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276715392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.031689:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276715392:12345-0@lo:400:kworker.0 Request processed in 106us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.031697:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789126842.031967:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276715776:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032040:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276716288:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032095:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276716800:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032144:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789126842.032152:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276715648:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276716160:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032257:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276716672:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.032279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126842.032306:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715776 00000100:00100000:3.0:1789126842.032311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715776 00000100:00100000:3.0:1789126842.032339:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716160 00000100:00100000:3.0:1789126842.032341:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716160 00000100:00100000:3.0:1789126842.032364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716672 00000100:00100000:3.0:1789126842.032366:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716672 00000100:00100000:2.0:1789126842.033231:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276715904:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126842.033323:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276716416:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126842.033369:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276716928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126842.033511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126842.033537:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789126842.033545:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276716032:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126842.033582:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276716544:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126842.033675:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716288 00000100:00100000:2.0:1789126842.033682:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716288 00000100:00100000:2.0:1789126842.033724:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716800 00000100:00100000:2.0:1789126842.033728:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716800 00000100:00100000:2.0:1789126842.033746:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716416 00000100:00100000:2.0:1789126842.033749:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716416 00000100:00100000:2.0:1789126842.033766:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789126842.033774:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276716288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033832:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276716288:12345-0@lo:400:kworker.0 Request processed in 58us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126842.033839:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789126842.033860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126842.033866:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276716800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033896:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276716800:12345-0@lo:400:kworker.0 Request processed in 30us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126842.033903:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126842.033913:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126842.033920:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276716416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.033951:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276716416:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126842.033958:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126842.033977:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716928 00000100:00100000:2.0:1789126842.033981:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716928 00000100:00100000:2.0:1789126842.034004:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789126842.034010:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276716928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126842.034029:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126842.034067:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276716928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126842.034074:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789126842.034114:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104310f00 x1876035276716416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.034132:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276716416:0@lo:400:kworker.0 00010000:00080000:2.0:1789126842.034145:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043070c0 x1876035276716928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.034161:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276716928:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789126842.034200:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043121c0 x1876035276716288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.034210:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276716288:0@lo:400:kworker.0 00010000:00080000:2.0:1789126842.034220:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423664d2c0 x1876035276716800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.034228:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276716800:0@lo:400:kworker.0 00000100:00100000:1.0:1789126842.034338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715648 00000100:00100000:1.0:1789126842.034343:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715648 00000100:00100000:1.0:1789126842.034493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276715904 00000100:00100000:1.0:1789126842.034498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276715904 00000100:00100000:1.0:1789126842.034517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126842.034525:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276715648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126842.034568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276715648:12345-0@lo:400:kworker.0 Request processed in 44us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126842.034574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126842.034588:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789126842.034594:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276715904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126842.034635:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276715904:12345-0@lo:400:kworker.0 Request processed in 41us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126842.034641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789126842.034733:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716032 00000100:00100000:3.0:1789126842.034738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716032 00000100:00100000:3.0:1789126842.034763:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276716544 00000100:00100000:3.0:1789126842.034766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276716544 00000100:00100000:3.0:1789126842.034780:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789126842.034786:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276715776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.034823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276715776:12345-0@lo:400:kworker.0 Request processed in 38us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.034829:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789126842.034842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789126842.034848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276716160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.034874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276716160:12345-0@lo:400:kworker.0 Request processed in 27us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.034880:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789126842.034889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789126842.034895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276716672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.034939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276716672:12345-0@lo:400:kworker.0 Request processed in 44us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.034946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789126842.034957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789126842.034962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276716032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.034990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276716032:12345-0@lo:400:kworker.0 Request processed in 28us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.034996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789126842.035006:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789126842.035012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276716544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.035037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276716544:12345-0@lo:400:kworker.0 Request processed in 25us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126842.035043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789126842.035085:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126842.035091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126842.035094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126842.035097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126842.035132:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276715520:0@lo:400:kworker.0 00000100:00100000:3.0:1789126842.035145:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276715392:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.040516:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276716032:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.040540:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104310b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276716544:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.040554:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276715904:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.040611:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276715648:0@lo:400:kworker.0 00010000:00080000:2.0:1789126842.040639:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276716160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.040673:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276716160:0@lo:400:kworker.0 00010000:00080000:2.0:1789126842.040710:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423664cb40 x1876035276716672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126842.040720:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276716672:0@lo:400:kworker.0 00000100:00100000:2.0:1789126842.040735:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276715776:0@lo:400:kworker.0 00010000:00010000:3.0:1789126842.796584:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126843.819176:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126844.079282:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126844.080119:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276717056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126844.080283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126844.080913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717056 00000100:00100000:2.0:1789126844.080925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717056 00000100:00100000:2.0:1789126844.081039:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789126844.081053:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276717056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126844.081098:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126844.081192:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276717056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126844.081200:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789126844.081290:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276717056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126844.588881:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126844.588903:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276717184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126844.588974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126844.589488:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276717312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126844.589524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126844.589932:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717184 00000100:00100000:2.0:1789126844.589940:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717184 00000100:00100000:2.0:1789126844.589989:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717312 00000100:00100000:2.0:1789126844.589993:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717312 00000100:00100000:2.0:1789126844.590011:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789126844.590019:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276717184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126844.590049:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126844.590093:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789126844.590102:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276717312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789126844.590112:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789126844.591263:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126844.591435:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276717312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1331us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126844.591446:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789126844.592951:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f9e4780 x1876035276717312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126844.592976:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276717312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126844.593729:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276717184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3705us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126844.593740:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789126844.600661:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276717184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126844.601259:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276717184:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789126844.844030:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789126844.919763:0:11986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:40:43 (1789126843) === 00000100:00100000:0.0:1789126845.263491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.263534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.263576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.263672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820864 00000100:00100000:1.0:1789126845.263682:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820864 00000100:00100000:1.0:1789126845.263754:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820736 00000100:00100000:1.0:1789126845.263757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820736 00000100:00100000:1.0:1789126845.263778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:1.0:1789126845.263787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258820864:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126845.263858:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258820864:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.263866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:1.0:1789126845.263884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1789126845.263891:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258820736:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126845.263918:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258820736:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.263924:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:3.0:1789126845.264157:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820608 00000100:00100000:3.0:1789126845.264162:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820608 00000100:00100000:3.0:1789126845.264199:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 285 00000100:00100000:3.0:1789126845.264207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258820608:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126845.264249:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258820608:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.264256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 285 00000100:00080000:0.0:1789126845.264742:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789126845.264747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126845.293587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126845.293823:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258820992 00000100:00100000:3.0:1789126845.293833:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258820992 00000100:00100000:3.0:1789126845.293893:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 286 00000100:00100000:3.0:1789126845.293904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:8708:x1876035258820992:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789126845.293921:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126845.293939:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f800/0xa840b4da666eaa55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c29e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126845.293968:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f800/0xa840b4da666eaa55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c29e expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126845.293980:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f800/0xa840b4da666eaa55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c29e expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126845.293990:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f800, rc 0) 00000100:00100000:3.0:1789126845.294057:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258820992:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 155us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.294064:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 286 00000100:00100000:3.0:1789126845.302811:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.302911:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821120 00000100:00100000:2.0:1789126845.302921:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821120 00000100:00100000:2.0:1789126845.302977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 287 00000100:00100000:2.0:1789126845.302997:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258821120:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789126845.303159:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258821120:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 172us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.303168:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 287 00000100:00100000:1.0:1789126845.310828:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.310932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821248 00000100:00100000:0.0:1789126845.310941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821248 00000100:00100000:0.0:1789126845.311005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 288 00000100:00100000:0.0:1789126845.311016:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258821248:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789126845.311175:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258821248:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.311183:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 288 00000100:00100000:0.0:1789126845.314102:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126845.314352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821376 00000100:00100000:3.0:1789126845.314360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821376 00000100:00100000:3.0:1789126845.314423:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 289 00000100:00100000:3.0:1789126845.314433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821376:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789126845.314577:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821376:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 145us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.314590:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 289 00000100:00100000:3.0:1789126845.342915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.353912:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821504 00000100:00100000:2.0:1789126845.353929:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821504 00000100:00100000:2.0:1789126845.354001:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:2.0:1789126845.354013:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821504:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789126845.354205:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821504:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 192us (11305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.354216:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:1.0:1789126845.364868:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.365108:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821632 00000100:00100000:0.0:1789126845.365125:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821632 00000100:00100000:0.0:1789126845.365218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:0.0:1789126845.365229:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821632:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789126845.365407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8712:x1876035258821632:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 180us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.365415:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:3.0:1789126845.376966:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.378990:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821760 00000100:00100000:0.0:1789126845.379006:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821760 00000100:00100000:0.0:1789126845.379081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00100000:0.0:1789126845.379091:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:8708:x1876035258821760:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789126845.379108:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126845.379130:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca400/0xa840b4da666eaa5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c2cf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.379161:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca400/0xa840b4da666eaa5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2cf expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.379172:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca400/0xa840b4da666eaa5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2cf expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.379181:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca400, rc 0) 00000100:00100000:0.0:1789126845.379252:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:8708:x1876035258821760:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 162us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.379259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00100000:3.0:1789126845.387014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.387168:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258821888 00000100:00100000:2.0:1789126845.387178:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258821888 00000100:00100000:2.0:1789126845.387236:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 293 00000100:00100000:2.0:1789126845.387248:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:8708:x1876035258821888:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789126845.387276:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789126845.387302:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789126845.387307:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789126845.387310:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789126845.387313:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789126845.387316:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789126845.389030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:8708:x1876035258821888:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 1775us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.389043:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 293 00000100:00100000:3.0:1789126845.392168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.392276:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822016 00000100:00100000:0.0:1789126845.392287:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822016 00000100:00100000:0.0:1789126845.392345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 294 00000100:00100000:0.0:1789126845.392355:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:8708:x1876035258822016:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789126845.392385:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126845.392418:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c2d6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.392457:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.392470:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126845.392479:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:0.0:1789126845.392537:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8708:x1876035258822016:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 183us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.392545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 294 00000100:00100000:3.0:1789126845.396861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.396951:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822144 00000100:00100000:2.0:1789126845.396961:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822144 00000100:00100000:2.0:1789126845.397011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 295 00000100:00100000:2.0:1789126845.397021:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8708:x1876035258822144:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789126845.397170:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8708:x1876035258822144:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.397179:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 295 00000100:00100000:1.0:1789126845.398922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126845.398999:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822272 00000100:00100000:3.0:1789126845.399007:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822272 00000100:00100000:3.0:1789126845.399058:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 296 00000100:00100000:3.0:1789126845.399067:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8708:x1876035258822272:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789126845.399211:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8708:x1876035258822272:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.399220:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 296 00000100:00100000:3.0:1789126845.401198:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.401298:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822400 00000100:00100000:0.0:1789126845.401308:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822400 00000100:00100000:0.0:1789126845.401369:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 297 00000100:00100000:0.0:1789126845.401379:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8716:x1876035258822400:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789126845.401549:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8716:x1876035258822400:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 171us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.401557:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 297 00000100:00100000:0.0:1789126845.407832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.407919:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822528 00000100:00100000:2.0:1789126845.407930:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822528 00000100:00100000:2.0:1789126845.407992:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 298 00000100:00100000:2.0:1789126845.408003:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8716:x1876035258822528:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789126845.408261:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:8716:x1876035258822528:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 259us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.408270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 298 00000100:00100000:1.0:1789126845.427358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.427399:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.427433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.427468:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.427497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.427528:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822656 00000100:00100000:1.0:1789126845.427538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822656 00000100:00100000:1.0:1789126845.427583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822912 00000100:00100000:1.0:1789126845.427586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822912 00000100:00100000:1.0:1789126845.427592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823552 00000100:00100000:1.0:1789126845.427594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823552 00000100:00100000:1.0:1789126845.427624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823424 00000100:00100000:1.0:1789126845.427628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823424 00000100:00100000:1.0:1789126845.427643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:1.0:1789126845.427683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258823552:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126845.427770:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258823552:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.427777:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:1.0:1789126845.427795:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1789126845.427802:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258823424:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126845.427827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258823424:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.427833:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1789126845.427845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789126845.427850:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1876035258822656:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789126845.427871:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 55f22eda-f51b-4ffa-ab32-c741beec7900@192.168.203.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1789126845.427913:0:6512:0:(genops.c:1385:class_connect()) connect: client 55f22eda-f51b-4ffa-ab32-c741beec7900, cookie 0xa840b4da666eaa6a 00000004:00100000:1.0:1789126845.427940:0:6512:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789126845.428051:0:6512:0:(import.c:65:import_set_state_nolock()) ffff994229776000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126845.428083:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2390:x1876035258822656:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 232us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.428090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789126845.428105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789126845.428117:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1876035258822912:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789126845.428133:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 55f22eda-f51b-4ffa-ab32-c741beec7900@192.168.203.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1789126845.428156:0:6512:0:(genops.c:1385:class_connect()) connect: client 55f22eda-f51b-4ffa-ab32-c741beec7900, cookie 0xa840b4da666eaa71 00000004:00100000:1.0:1789126845.428170:0:6512:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789126845.428226:0:6512:0:(import.c:65:import_set_state_nolock()) ffff994229775800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789126845.428252:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2390:x1876035258822912:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 134us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.428258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1789126845.428608:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823296 00000100:00100000:0.0:1789126845.428615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823296 00000100:00100000:0.0:1789126845.428678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 299 00000100:00100000:0.0:1789126845.428685:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258823296:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126845.428725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258823296:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126845.428740:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 299 00000100:00100000:1.0:1789126845.434679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.434730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126845.434807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126845.434885:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258822784 00000100:00100000:3.0:1789126845.434895:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258822784 00000100:00100000:3.0:1789126845.434962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823168 00000100:00100000:3.0:1789126845.434965:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823168 00000100:00100000:3.0:1789126845.434976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823040 00000100:00100000:3.0:1789126845.434978:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823040 00000100:00100000:3.0:1789126845.434994:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1789126845.435003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+7:0:x1876035258822784:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789126845.435041:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126845.435121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+7:0:x1876035258822784:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 119us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.435129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1789126845.435159:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789126845.435165:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258823168:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789126845.435178:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126845.435201:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258823168:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.435207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789126845.435221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1789126845.435228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:0:x1876035258823040:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789126845.435260:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126845.435296:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:0:x1876035258823040:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 68us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.435302:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00080000:1.0:1789126845.436193:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126845.436199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126845.438040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126845.438119:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823680 00000100:00100000:3.0:1789126845.438128:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823680 00000100:00100000:3.0:1789126845.438192:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1789126845.438203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258823680:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789126845.438294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258823680:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.438302:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789126845.443775:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.443816:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126845.443847:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.443934:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823808 00000100:00100000:2.0:1789126845.443944:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823808 00000100:00100000:2.0:1789126845.443989:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258823936 00000100:00100000:2.0:1789126845.443993:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258823936 00000100:00100000:2.0:1789126845.444011:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1789126845.444019:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258823808:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789126845.444053:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 55f22eda-f51b-4ffa-ab32-c741beec7900@192.168.203.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1789126845.444088:0:8428:0:(genops.c:1385:class_connect()) connect: client 55f22eda-f51b-4ffa-ab32-c741beec7900, cookie 0xa840b4da666eaa78 00002000:00100000:2.0:1789126845.444100:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55f22eda-f51b-4ffa-ab32-c741beec7900/ffff9941032b3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789126845.444113:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789126845.444197:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789126845.444226:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9941032b1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126845.444285:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2390:x1876035258823808:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 266us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.444293:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1789126845.444310:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1789126845.444314:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258823936:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789126845.444330:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 55f22eda-f51b-4ffa-ab32-c741beec7900@192.168.203.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1789126845.444344:0:8428:0:(genops.c:1385:class_connect()) connect: client 55f22eda-f51b-4ffa-ab32-c741beec7900, cookie 0xa840b4da666eaa7f 00002000:00100000:2.0:1789126845.444349:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55f22eda-f51b-4ffa-ab32-c741beec7900/ffff9941032b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789126845.444360:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789126845.444396:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789126845.444412:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9941032b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126845.444436:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2390:x1876035258823936:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.444446:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1789126845.444683:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824064 00000100:00100000:1.0:1789126845.444688:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824064 00000100:00100000:1.0:1789126845.444731:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789126845.444738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258824064:12345-192.168.203.23@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789126845.444793:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258824064:12345-192.168.203.23@tcp:900:mount.lustre.0 Request processed in 55us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126845.444799:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1789126845.448336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126845.450797:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824192 00000100:00100000:2.0:1789126845.450813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824192 00000100:00100000:2.0:1789126845.450886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1789126845.450898:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258824192:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789126845.450995:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789126845.451100:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:8708:x1876035258824192:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 203us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126845.451109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1789126845.611127:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276717440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126845.611225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126845.611427:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717440 00000100:00100000:3.0:1789126845.611444:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717440 00000100:00100000:3.0:1789126845.611500:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789126845.611510:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276717440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126845.611538:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126845.611584:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276717440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126845.611610:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789126845.611885:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276717440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789126845.871023:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126846.891848:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126847.147065:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276717696:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147229:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276718208:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147285:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276718720:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789126847.147337:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276717824:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147377:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276718336:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147429:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276718848:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.147486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717696 00000100:00100000:1.0:1789126847.147493:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717696 00000100:00100000:1.0:1789126847.147530:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718208 00000100:00100000:1.0:1789126847.147534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718208 00000100:00100000:1.0:1789126847.147554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718720 00000100:00100000:1.0:1789126847.147557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718720 00000100:00100000:1.0:1789126847.147569:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718336 00000100:00100000:1.0:1789126847.147571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718336 00000100:00100000:1.0:1789126847.147604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718848 00000100:00100000:1.0:1789126847.147607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718848 00000100:00100000:1.0:1789126847.147621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789126847.147629:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276717696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147720:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276717696:12345-0@lo:400:kworker.0 Request processed in 79us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.147728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789126847.147747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126847.147753:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276718208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276718208:12345-0@lo:400:kworker.0 Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.147797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126847.147811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789126847.147816:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104028b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276718720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104028b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276718720:12345-0@lo:400:kworker.0 Request processed in 44us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.147866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789126847.147877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789126847.147883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276718336:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.147912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789126847.147922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789126847.147926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276718848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.147947:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276718848:12345-0@lo:400:kworker.0 Request processed in 20us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.147952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789126847.147968:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717824 00000100:00100000:1.0:1789126847.147971:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717824 00000100:00100000:1.0:1789126847.147993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789126847.147999:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276717824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.148027:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276717824:12345-0@lo:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.148032:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789126847.148050:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126847.148054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126847.148091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e0983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276717824:0@lo:400:kworker.0 00010000:00080000:1.0:1789126847.148105:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d1a40 x1876035276718336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126847.148115:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276718336:0@lo:400:kworker.0 00010000:00080000:1.0:1789126847.148124:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec3c00 x1876035276718848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126847.148132:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276718848:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.148141:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276717696:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.148149:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276718208:0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.148157:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276718720:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.150732:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276717568:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.150807:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.150847:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276718080:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.150875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.150893:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276718592:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.150916:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.150935:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276719104:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.150955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.150976:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789126847.150982:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276717952:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.151036:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.151055:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276718464:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.151077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.151092:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276718976:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.151109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126847.151139:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718592 00000100:00100000:0.0:1789126847.151145:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718592 00000100:00100000:2.0:1789126847.152393:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717568 00000100:00100000:2.0:1789126847.152403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717568 00000100:00100000:2.0:1789126847.152459:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789126847.152470:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276717568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126847.152546:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276717568:12345-0@lo:400:kworker.0 Request processed in 79us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126847.152554:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789126847.152602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718080 00000100:00100000:2.0:1789126847.152606:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718080 00000100:00100000:2.0:1789126847.152631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789126847.152638:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276718080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126847.152693:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276718080:12345-0@lo:400:kworker.0 Request processed in 55us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126847.152699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789126847.153302:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126847.153315:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104028780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276719232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126847.153350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.153386:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719232 00000100:00100000:1.0:1789126847.153390:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719232 00000100:00100000:1.0:1789126847.153427:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789126847.154357:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719104 00000100:00100000:0.0:1789126847.154365:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719104 00000100:00100000:0.0:1789126847.154398:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718464 00000100:00100000:0.0:1789126847.154402:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718464 00000100:00100000:0.0:1789126847.154415:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276718976 00000100:00100000:0.0:1789126847.154417:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276718976 00000100:00100000:0.0:1789126847.154615:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789126847.154628:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276718592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.154719:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276718592:12345-0@lo:400:kworker.0 Request processed in 83us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.154773:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276719232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126847.154809:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126847.154849:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276719232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.154857:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789126847.154880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126847.154884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789126847.154919:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104028780 x1876035276719232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126847.154945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104028780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276719232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126847.154975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276717952 00000100:00100000:1.0:1789126847.154979:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276717952 00000100:00100000:1.0:1789126847.155023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789126847.155031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276717952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126847.155065:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276717952:12345-0@lo:400:kworker.0 Request processed in 35us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.155071:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789126847.155250:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276717952:0@lo:400:kworker.0 00000100:00100000:2.0:1789126847.155262:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276717568:0@lo:400:kworker.0 00000100:00100000:2.0:1789126847.155272:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276718080:0@lo:400:kworker.0 00010000:00080000:2.0:1789126847.155283:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675c3c0 x1876035276718592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126847.155292:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276718592:0@lo:400:kworker.0 00000100:00100000:3.0:1789126847.162402:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789126847.162444:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276719104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126847.162548:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276719104:12345-0@lo:400:kworker.0 Request processed in 134us (11591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126847.162557:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789126847.162605:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789126847.162613:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276718464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126847.162675:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276718464:12345-0@lo:400:kworker.0 Request processed in 63us (11596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126847.162681:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789126847.162694:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789126847.162700:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276718976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126847.162735:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276718976:12345-0@lo:400:kworker.0 Request processed in 35us (11624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126847.162741:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789126847.162859:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675c780 x1876035276718464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126847.162874:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276718464:0@lo:400:kworker.0 00010000:00080000:3.0:1789126847.162886:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec21c0 x1876035276718976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126847.162895:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276718976:0@lo:400:kworker.0 00010000:00080000:3.0:1789126847.162907:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104159680 x1876035276719104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126847.162930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276719104:0@lo:400:kworker.0 00000100:00100000:0.0:1789126847.175040:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789126847.175506:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104028780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276719360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126847.175599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126847.183344:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719360 00000100:00100000:1.0:1789126847.183359:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719360 00000100:00100000:1.0:1789126847.183424:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789126847.183441:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276719360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126847.183467:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126847.183545:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276719360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (7947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126847.183552:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789126847.184344:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104028780 x1876035276719360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126847.184366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104028780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276719360:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789126847.914847:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126848.942579:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126849.196633:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276719488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126849.198717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126849.200131:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719488 00000100:00100000:1.0:1789126849.200141:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719488 00000100:00100000:1.0:1789126849.200186:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789126849.200194:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276719488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789126849.200226:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789126849.200286:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276719488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126849.200293:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789126849.200336:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276719488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126849.707920:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126849.707942:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276719616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126849.708006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126849.708074:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719616 00000100:00100000:2.0:1789126849.708082:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719616 00000100:00100000:2.0:1789126849.708134:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789126849.708145:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276719616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126849.708172:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126849.708211:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276719616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126849.708217:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789126849.708265:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675c780 x1876035276719616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126849.708281:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276719616:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126849.708316:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126849.714914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276719744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126849.714994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126849.716380:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719744 00000100:00100000:2.0:1789126849.716391:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719744 00000100:00100000:2.0:1789126849.716463:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789126849.716474:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276719744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126849.716496:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126849.716566:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276719744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126849.716584:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789126849.716689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789126849.716770:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104158000 x1876035276719744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126849.716790:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276719744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789126849.963014:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126850.732074:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789126850.732105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276719872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126850.732203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126850.732474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276719872 00000100:00100000:3.0:1789126850.732483:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276719872 00000100:00100000:3.0:1789126850.732546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126850.732556:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276719872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126850.732607:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126850.733145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276719872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 587us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126850.733155:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126850.733227:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276719872:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1789126850.735802:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00100000:1.0:1789126850.744132:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00100000:3.0:1789126850.749482:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00100000:1.0:1789126850.751031:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000100:00100000:2.0:1789126850.895465:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126850.895506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126850.895553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126850.895635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126850.895679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824448 00000100:00100000:2.0:1789126850.895687:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824448 00000100:00100000:2.0:1789126850.895740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824576 00000100:00100000:2.0:1789126850.895743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824576 00000100:00100000:2.0:1789126850.895756:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824704 00000100:00100000:2.0:1789126850.895758:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824704 00000100:00100000:2.0:1789126850.895776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:2.0:1789126850.895786:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258824448:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126850.895860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258824448:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 75us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126850.895868:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:2.0:1789126850.895885:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1789126850.895891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258824576:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126850.895916:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258824576:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126850.895922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1789126850.895934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:2.0:1789126850.895940:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824704:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126850.895964:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824704:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126850.895970:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00080000:2.0:1789126850.895990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126850.895994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126850.896250:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824320 00000100:00100000:0.0:1789126850.896255:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824320 00000100:00100000:0.0:1789126850.896288:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 301 00000100:00100000:0.0:1789126850.896297:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258824320:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126850.896346:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258824320:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 50us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126850.896353:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 301 00000100:00100000:0.0:1789126850.897889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126850.897921:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126850.897950:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126850.897976:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824960 00000100:00100000:0.0:1789126850.897982:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824960 00000100:00100000:0.0:1789126850.898031:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825088 00000100:00100000:0.0:1789126850.898035:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825088 00000100:00100000:0.0:1789126850.898057:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1789126850.898066:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824960:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126850.898123:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824960:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126850.898131:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1789126850.898146:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1789126850.898153:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258825088:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126850.898178:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258825088:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126850.898185:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00080000:0.0:1789126850.898208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126850.898211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126850.900035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258824832 00000100:00100000:2.0:1789126850.900051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258824832 00000100:00100000:2.0:1789126850.900110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:2.0:1789126850.900120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824832:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126850.900186:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258824832:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 67us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126850.900193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00080000:1.0:1789126850.904814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789126850.987069:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789126851.639175:0:12179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789126852.012632:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126852.267175:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276720384:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267322:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276720896:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276721408:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267421:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789126852.267428:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276720256:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267469:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276720768:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267504:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276721280:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126852.267559:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720384 00000100:00100000:2.0:1789126852.267566:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720384 00000100:00100000:2.0:1789126852.267608:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720768 00000100:00100000:2.0:1789126852.267611:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720768 00000100:00100000:2.0:1789126852.267631:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721280 00000100:00100000:2.0:1789126852.267633:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721280 00000100:00100000:2.0:1789126852.267687:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789126852.267705:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276720384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.267990:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276720384:12345-0@lo:400:kworker.0 Request processed in 286us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.267997:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789126852.268013:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789126852.268019:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276720768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268043:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276720768:12345-0@lo:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.268048:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789126852.268056:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789126852.268060:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276721280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268078:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276721280:12345-0@lo:400:kworker.0 Request processed in 18us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.268083:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789126852.268099:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720896 00000100:00100000:2.0:1789126852.268102:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720896 00000100:00100000:2.0:1789126852.268122:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721408 00000100:00100000:2.0:1789126852.268124:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721408 00000100:00100000:2.0:1789126852.268137:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789126852.268142:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276720896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268168:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276720896:12345-0@lo:400:kworker.0 Request processed in 26us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.268175:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789126852.268186:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789126852.268192:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276721408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268219:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276721408:12345-0@lo:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.268233:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789126852.268256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720256 00000100:00100000:2.0:1789126852.268260:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720256 00000100:00100000:2.0:1789126852.268283:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789126852.268290:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276720256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268323:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276720256:12345-0@lo:400:kworker.0 Request processed in 34us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126852.268329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789126852.268380:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276720256:0@lo:400:kworker.0 00010000:00080000:2.0:1789126852.268393:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa2ad00 x1876035276720768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126852.268403:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276720768:0@lo:400:kworker.0 00010000:00080000:2.0:1789126852.268413:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa29a40 x1876035276721280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126852.268420:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276721280:0@lo:400:kworker.0 00000100:00100000:2.0:1789126852.268431:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276720384:0@lo:400:kworker.0 00010000:00080000:2.0:1789126852.268440:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa29680 x1876035276720896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126852.268447:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276720896:0@lo:400:kworker.0 00010000:00080000:2.0:1789126852.268455:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa2b480 x1876035276721408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126852.268463:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276721408:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.268911:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276720128:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.268972:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269004:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276720640:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269045:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269093:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789126852.269099:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276720000:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269147:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276720512:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269184:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721024:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269224:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721536:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269243:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.269272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720512 00000100:00100000:3.0:1789126852.269277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720512 00000100:00100000:3.0:1789126852.269307:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126852.269314:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276720512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276720512:12345-0@lo:400:kworker.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126852.269364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126852.269381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720128 00000100:00100000:3.0:1789126852.269385:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720128 00000100:00100000:3.0:1789126852.269407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720640 00000100:00100000:3.0:1789126852.269410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720640 00000100:00100000:3.0:1789126852.269424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721152 00000100:00100000:3.0:1789126852.269426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721152 00000100:00100000:3.0:1789126852.269440:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789126852.269447:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276720128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269478:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276720128:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126852.269484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789126852.269504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789126852.269510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276720640:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126852.269545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789126852.269569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789126852.269574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276721152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.269597:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276721152:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126852.269602:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789126852.269622:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721024 00000100:00100000:3.0:1789126852.269625:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721024 00000100:00100000:3.0:1789126852.269684:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721536 00000100:00100000:3.0:1789126852.269688:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721536 00000100:00100000:3.0:1789126852.269704:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789126852.269711:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.270181:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789126852.270193:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.270232:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721536:12345-0@lo:400:kworker.0 Request processed in 44us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126852.270248:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789126852.270331:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276720512:0@lo:400:kworker.0 00010000:00080000:0.0:1789126852.270344:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa2b0c0 x1876035276721024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126852.270353:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721024:0@lo:400:kworker.0 00010000:00080000:0.0:1789126852.270362:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa29e00 x1876035276721536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126852.270370:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721536:0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.270379:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276720128:0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.270388:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276720640:0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.270399:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789126852.270522:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721024:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126852.270530:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789126852.270873:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276720000 00000100:00100000:0.0:1789126852.270877:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276720000 00000100:00100000:0.0:1789126852.270909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789126852.270917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276720000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.271223:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276720000:12345-0@lo:400:kworker.0 Request processed in 306us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126852.271229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789126852.271305:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276721792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126852.271336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126852.271369:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721792 00000100:00100000:0.0:1789126852.271373:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721792 00000100:00100000:0.0:1789126852.271405:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789126852.271411:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276721792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126852.271433:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126852.271470:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276721792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126852.271477:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789126852.271504:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103077c00 x1876035276721792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126852.271518:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276721792:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789126852.271596:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126852.271601:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126852.271604:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126852.271606:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126852.271676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126852.271705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126852.271738:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104132580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276720000:0@lo:400:kworker.0 00000100:00100000:0.0:1789126852.272079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721664 00000100:00100000:0.0:1789126852.272084:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721664 00000100:00100000:0.0:1789126852.272120:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789126852.272128:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789126852.272139:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126852.272179:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276721664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126852.272185:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789126852.272350:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103074780 x1876035276721664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126852.272364:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276721664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789126853.034884:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126854.070571:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126854.316857:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126854.316880:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276721920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126854.316951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126854.318170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276721920 00000100:00100000:3.0:1789126854.318179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276721920 00000100:00100000:3.0:1789126854.318243:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126854.318253:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276721920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126854.318286:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126854.318350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276721920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126854.318357:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126854.318403:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276721920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126854.827011:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126854.827039:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276722048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126854.827112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126854.827284:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722048 00000100:00100000:3.0:1789126854.827292:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722048 00000100:00100000:3.0:1789126854.827349:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789126854.827360:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276722048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126854.827361:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276722176:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126854.827388:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126854.827389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126854.827416:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722176 00000100:00100000:2.0:1789126854.827420:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722176 00000100:00100000:3.0:1789126854.827428:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276722048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126854.827436:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789126854.827442:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789126854.827447:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276722176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126854.827457:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126854.827482:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276722176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (92us total) trans 0 rc 0/0 00010000:00080000:3.0:1789126854.827484:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104159680 x1876035276722048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126854.827489:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789126854.827501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276722048:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789126854.827521:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa2b480 x1876035276722176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126854.827542:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276722176:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789126854.827599:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789126855.083860:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126855.852320:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276722304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126855.852404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126855.852481:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722304 00000100:00100000:3.0:1789126855.852489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722304 00000100:00100000:3.0:1789126855.852577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126855.852601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994210e42450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276722304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126855.852636:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126855.852701:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994210e42450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276722304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126855.852708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126855.852976:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276722304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126856.024223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024263:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024307:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024416:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126856.024446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825344 00000100:00100000:3.0:1789126856.024454:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825344 00000100:00100000:3.0:1789126856.024508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825600 00000100:00100000:3.0:1789126856.024511:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825600 00000100:00100000:3.0:1789126856.024535:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825472 00000100:00100000:3.0:1789126856.024538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825472 00000100:00100000:3.0:1789126856.024550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825728 00000100:00100000:3.0:1789126856.024552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825728 00000100:00100000:3.0:1789126856.024568:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:3.0:1789126856.024576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258825344:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.024646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258825344:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:3.0:1789126856.024696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:3.0:1789126856.024703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.024730:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:3.0:1789126856.024747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:3.0:1789126856.024753:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258825472:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.024777:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258825472:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024794:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:3.0:1789126856.024808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:3.0:1789126856.024814:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825728:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.024837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825728:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:3.0:1789126856.024869:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825856 00000100:00100000:3.0:1789126856.024872:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825856 00000100:00100000:3.0:1789126856.024898:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825984 00000100:00100000:3.0:1789126856.024901:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825984 00000100:00100000:3.0:1789126856.024923:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1789126856.024930:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825856:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126856.024937:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1789126856.024945:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825984:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.024954:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825856:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024966:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1789126856.024968:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258825984:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.024984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258825216 00000100:00100000:3.0:1789126856.024988:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258825216 00000100:00100000:3.0:1789126856.025011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 303 00000100:00100000:3.0:1789126856.025018:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258825216:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126856.025043:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258825216:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126856.025049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 303 00000100:00080000:3.0:1789126856.025085:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126856.025089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126856.025092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126856.025094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126856.025338:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00010000:00010000:3.0:1789126856.106827:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126857.136315:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126857.387016:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276722432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126857.387088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.387209:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722432 00000100:00100000:1.0:1789126857.387216:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722432 00000100:00100000:1.0:1789126857.387277:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126857.387287:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276722432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126857.387325:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126857.387371:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276722432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126857.387378:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789126857.387439:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030770c0 x1876035276722432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126857.387459:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276722432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126857.387669:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276722560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126857.387700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126857.387774:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722560 00000100:00100000:0.0:1789126857.387778:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722560 00000100:00100000:0.0:1789126857.387812:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789126857.387818:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104029680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276722560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789126857.387834:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126857.387863:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104029680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276722560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126857.387870:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789126857.387931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030752c0 x1876035276722560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126857.387943:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276722560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126857.388201:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276722816:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126857.388255:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276723328:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126857.388283:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236636940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276723840:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126857.388322:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789126857.388327:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276722944:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126857.388404:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276723456:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126857.388438:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276723968:0@lo:400:kworker.0 00000100:00100000:2.0:1789126857.388456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388565:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722944 00000100:00100000:1.0:1789126857.388570:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722944 00000100:00100000:1.0:1789126857.388607:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789126857.388614:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276722944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388684:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276722944:12345-0@lo:400:kworker.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126857.388691:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789126857.388709:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276723072:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388746:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276723584:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388782:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789126857.388788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276722688:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388837:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103076d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276723200:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388878:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276723712:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.388899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126857.388923:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722688 00000100:00100000:1.0:1789126857.388926:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722688 00000100:00100000:1.0:1789126857.388970:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789126857.388977:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276722688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.389012:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276722688:12345-0@lo:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126857.389019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789126857.389057:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276722944:0@lo:400:kworker.0 00000100:00100000:1.0:1789126857.389079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276722688:0@lo:400:kworker.0 00000100:00080000:3.0:1789126857.389158:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126857.389175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276722816 00000100:00100000:3.0:1789126857.389178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276722816 00000100:00100000:3.0:1789126857.389199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723328 00000100:00100000:3.0:1789126857.389202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723328 00000100:00100000:3.0:1789126857.389227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723840 00000100:00100000:3.0:1789126857.389230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723840 00000100:00100000:3.0:1789126857.389242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723456 00000100:00100000:3.0:1789126857.389244:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723456 00000100:00100000:3.0:1789126857.389254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723968 00000100:00100000:3.0:1789126857.389256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723968 00000100:00100000:3.0:1789126857.389266:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723072 00000100:00100000:3.0:1789126857.389268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723072 00000100:00100000:3.0:1789126857.389278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789126857.389291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276722816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389343:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276722816:12345-0@lo:400:kworker.0 Request processed in 53us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789126857.389364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789126857.389370:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276723328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389397:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276723328:12345-0@lo:400:kworker.0 Request processed in 27us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789126857.389414:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789126857.389419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276723840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276723840:12345-0@lo:400:kworker.0 Request processed in 27us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789126857.389462:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789126857.389468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276723456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389494:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276723456:12345-0@lo:400:kworker.0 Request processed in 27us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789126857.389511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789126857.389527:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276723968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389553:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276723968:12345-0@lo:400:kworker.0 Request processed in 37us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789126857.389569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789126857.389581:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276723072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389612:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276723072:12345-0@lo:400:kworker.0 Request processed in 33us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789126857.389642:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723584 00000100:00100000:3.0:1789126857.389670:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723584 00000100:00100000:3.0:1789126857.389695:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723712 00000100:00100000:3.0:1789126857.389698:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723712 00000100:00100000:3.0:1789126857.389716:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789126857.389722:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276723584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389755:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276723584:12345-0@lo:400:kworker.0 Request processed in 33us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389761:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789126857.389773:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789126857.389778:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276723712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389803:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276723712:12345-0@lo:400:kworker.0 Request processed in 25us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389808:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789126857.389825:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276723200 00000100:00100000:3.0:1789126857.389828:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276723200 00000100:00100000:3.0:1789126857.389847:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789126857.389852:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276723200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389883:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276723200:12345-0@lo:400:kworker.0 Request processed in 30us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126857.389889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789126857.389929:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103077c00 x1876035276723456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126857.389952:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276723456:0@lo:400:kworker.0 00010000:00080000:3.0:1789126857.389966:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236636580 x1876035276723968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126857.389974:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276723968:0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389986:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276722816:0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.389996:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276723328:0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.390006:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236636940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276723840:0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.390041:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103076d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276723200:0@lo:400:kworker.0 00010000:00080000:3.0:1789126857.390052:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236634b40 x1876035276723712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126857.390061:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276723712:0@lo:400:kworker.0 00000100:00100000:3.0:1789126857.390072:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276723072:0@lo:400:kworker.0 00010000:00080000:3.0:1789126857.390082:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103074780 x1876035276723584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126857.390090:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276723584:0@lo:400:kworker.0 00000100:00080000:1.0:1789126857.391346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126857.391354:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126857.391357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789126858.156875:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126859.182952:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789126859.411377:0:12495:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126859.412180:0:12495:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789126859.440387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126859.440509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126859.440584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724096 00000100:00100000:3.0:1789126859.440590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724096 00000100:00100000:3.0:1789126859.440635:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789126859.440674:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126859.440721:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126859.440765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126859.440772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789126859.440813:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126859.948266:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126859.948289:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126859.948391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126859.948461:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724224 00000100:00100000:1.0:1789126859.948468:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724224 00000100:00100000:1.0:1789126859.948534:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789126859.948544:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126859.948574:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126859.948618:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126859.948625:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789126859.948687:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126859.948719:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104029e00 x1876035276724224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126859.948737:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126859.957172:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276724352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789126859.957280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126859.957585:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724352 00000100:00100000:1.0:1789126859.957594:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724352 00000100:00100000:1.0:1789126859.957695:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789126859.957706:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276724352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126859.957729:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126859.957783:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276724352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126859.957791:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789126859.957830:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104029e00 x1876035276724352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126859.957859:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276724352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126859.958057:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789126860.202939:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126860.970886:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126860.970914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276724480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126860.970991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126860.972018:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724480 00000100:00100000:3.0:1789126860.972091:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724480 00000100:00100000:3.0:1789126860.972215:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789126860.972225:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104029e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276724480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126860.972261:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126860.972332:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104029e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276724480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126860.972348:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789126860.972422:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276724480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126861.141284:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.141402:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.141431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826240 00000100:00100000:0.0:1789126861.141441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826240 00000100:00100000:0.0:1789126861.141512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:0.0:1789126861.141522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258826240:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126861.142772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258826240:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1246us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126861.142783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00080000:0.0:1789126861.142814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126861.142854:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.142960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.142983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.142999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.143017:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126861.143038:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826496 00000100:00100000:0.0:1789126861.143043:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826496 00000100:00100000:0.0:1789126861.143801:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826368 00000100:00100000:0.0:1789126861.143806:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826368 00000100:00100000:3.0:1789126861.151328:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826112 00000100:00100000:3.0:1789126861.151344:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826112 00000100:00100000:3.0:1789126861.151413:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 305 00000100:00100000:3.0:1789126861.151424:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258826112:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126861.151507:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258826112:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 85us (10230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126861.151515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 305 00000100:00100000:1.0:1789126861.151878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826624 00000100:00100000:1.0:1789126861.151883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826624 00000100:00100000:1.0:1789126861.151933:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:1.0:1789126861.151940:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258826496:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126861.151981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258826496:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (9126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126861.152001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:1.0:1789126861.152041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:1.0:1789126861.152048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258826368:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126861.152090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258826368:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (9106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126861.152096:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:1.0:1789126861.152145:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:1.0:1789126861.152152:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258826624:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126861.152179:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258826624:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (9180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126861.152186:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:0.0:1789126861.156130:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826752 00000100:00100000:0.0:1789126861.156144:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826752 00000100:00100000:0.0:1789126861.156221:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258826880 00000100:00100000:0.0:1789126861.156224:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258826880 00000100:00100000:0.0:1789126861.156247:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789126861.156256:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258826752:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126861.156327:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258826752:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 72us (13367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126861.156335:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789126861.156349:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:0.0:1789126861.156355:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236636d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258826880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126861.156374:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236636d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258826880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 19us (13356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126861.156379:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00080000:0.0:1789126861.156394:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126861.156398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126861.156400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126861.156404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789126861.226836:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789126861.843228:0:12592:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789126861.845226:0:12592:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126862.257613:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126862.506963:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126862.507046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.507117:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724608 00000100:00100000:1.0:1789126862.507125:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724608 00000100:00100000:1.0:1789126862.507181:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789126862.507191:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104028780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126862.507218:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126862.507259:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104028780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276724608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.507266:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789126862.507318:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040283c0 x1876035276724608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126862.507349:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276724608:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789126862.507384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126862.507555:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126862.507566:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276724736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126862.507604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126862.507634:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724736 00000100:00100000:3.0:1789126862.507638:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724736 00000100:00100000:3.0:1789126862.507685:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789126862.507692:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276724736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126862.507703:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126862.507734:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276724736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126862.507741:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789126862.507755:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789126862.507771:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e7b480 x1876035276724736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126862.507785:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276724736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126862.527780:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276724864:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.527848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.527904:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103076d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276725376:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.527931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.527949:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276725888:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.527971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.527996:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789126862.528001:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104028f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276724992:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276725504:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528079:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276726016:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528130:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724864 00000100:00100000:1.0:1789126862.528137:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724864 00000100:00100000:1.0:1789126862.528178:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789126862.528187:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276724864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528233:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276724864:12345-0@lo:400:kworker.0 Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528240:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789126862.528272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725376 00000100:00100000:1.0:1789126862.528275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725376 00000100:00100000:1.0:1789126862.528312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789126862.528318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276725376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528355:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276725376:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789126862.528371:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725888 00000100:00100000:1.0:1789126862.528374:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725888 00000100:00100000:1.0:1789126862.528396:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126862.528400:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276725888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528418:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276725888:12345-0@lo:400:kworker.0 Request processed in 18us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528421:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789126862.528432:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276724992 00000100:00100000:1.0:1789126862.528434:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276724992 00000100:00100000:1.0:1789126862.528448:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725504 00000100:00100000:1.0:1789126862.528449:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725504 00000100:00100000:1.0:1789126862.528459:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726016 00000100:00100000:1.0:1789126862.528461:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726016 00000100:00100000:1.0:1789126862.528474:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789126862.528490:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276724992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528519:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276724992:12345-0@lo:400:kworker.0 Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528525:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789126862.528535:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789126862.528542:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276725504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528567:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276725504:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528582:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789126862.528595:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789126862.528601:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276726016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528628:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276726016:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.528633:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1789126862.528677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126862.528682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126862.528694:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276725248:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528718:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528735:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276725760:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528793:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789126862.528799:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276725120:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126862.528843:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276725632:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126862.528867:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725248 00000100:00100000:3.0:1789126862.528871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725248 00000100:00100000:1.0:1789126862.528874:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276726144:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.528892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126862.528893:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725632 00000100:00100000:3.0:1789126862.528895:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725632 00000100:00100000:3.0:1789126862.528994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726144 00000100:00100000:3.0:1789126862.529001:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726144 00000100:00100000:3.0:1789126862.529016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789126862.529022:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276725248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126862.529061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276725248:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126862.529066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789126862.529078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789126862.529083:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276725632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126862.529106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276725632:12345-0@lo:400:kworker.0 Request processed in 23us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126862.529118:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789126862.529129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789126862.529134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276726144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126862.529160:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276726144:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126862.529165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789126862.529476:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725760 00000100:00100000:1.0:1789126862.529488:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725760 00000100:00100000:1.0:1789126862.529518:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789126862.529526:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276725760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529558:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276725760:12345-0@lo:400:kworker.0 Request processed in 33us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.529574:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789126862.529592:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276725120 00000100:00100000:1.0:1789126862.529595:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276725120 00000100:00100000:1.0:1789126862.529616:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789126862.529623:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276725120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529673:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276725120:12345-0@lo:400:kworker.0 Request processed in 50us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126862.529678:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789126862.529698:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126862.529702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126862.529733:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276725120:0@lo:400:kworker.0 00010000:00080000:1.0:1789126862.529747:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030752c0 x1876035276725632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126862.529757:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276725632:0@lo:400:kworker.0 00010000:00080000:1.0:1789126862.529766:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423675e580 x1876035276726144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126862.529773:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276726144:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529784:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276725248:0@lo:400:kworker.0 00010000:00080000:1.0:1789126862.529792:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103077c00 x1876035276725760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126862.529800:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276725760:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529835:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104028f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276724992:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529845:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276725504:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529863:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276726016:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529873:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276724864:0@lo:400:kworker.0 00000100:00100000:1.0:1789126862.529882:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103076d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276725376:0@lo:400:kworker.0 00010000:00080000:1.0:1789126862.529892:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103075a40 x1876035276725888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126862.529900:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103075a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276725888:0@lo:400:kworker.0 00010000:00010000:0.0:1789126863.275292:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789126863.952091:0:12690:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789126863.953130:0:12690:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126864.304712:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126864.555837:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126864.555874:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276726272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126864.555975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126864.556076:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726272 00000100:00100000:3.0:1789126864.556086:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726272 00000100:00100000:3.0:1789126864.556155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789126864.556165:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276726272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126864.556215:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126864.556267:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276726272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126864.556275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789126864.556333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276726272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126865.067073:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276726400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126865.067191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126865.067304:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726400 00000100:00100000:2.0:1789126865.068072:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126865.068108:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276726528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126865.068173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126865.068219:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726528 00000100:00100000:2.0:1789126865.068229:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726528 00000100:00100000:2.0:1789126865.068309:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789126865.068334:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276726528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126865.069478:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726400 00000100:00100000:1.0:1789126865.069947:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789126865.069960:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276726400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126865.070010:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126865.070151:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276726400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 194us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126865.070160:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00002000:00000024:2.0:1789126865.070278:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126865.070332:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276726528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2001us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126865.070340:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789126865.070563:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa2b0c0 x1876035276726528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126865.070600:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276726528:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789126865.070619:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276726400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126865.070690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276726400:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126865.071040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789126865.326418:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126866.091408:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126866.091444:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276726656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126866.091561:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126866.092777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726656 00000100:00100000:3.0:1789126866.092796:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726656 00000100:00100000:3.0:1789126866.092895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789126866.092907:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276726656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126866.092970:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126866.093720:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276726656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 813us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126866.093753:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789126866.093830:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276726656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126866.255951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256126:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126866.256162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827264 00000100:00100000:1.0:1789126866.256195:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827264 00000100:00100000:1.0:1789126866.256289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827520 00000100:00100000:1.0:1789126866.256294:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827520 00000100:00100000:1.0:1789126866.256330:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827136 00000100:00100000:1.0:1789126866.256334:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827136 00000100:00100000:1.0:1789126866.256352:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827392 00000100:00100000:1.0:1789126866.256354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827392 00000100:00100000:1.0:1789126866.256379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:1.0:1789126866.256389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258827264:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126866.256541:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827008 00000100:00100000:3.0:1789126866.256546:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827008 00000100:00100000:3.0:1789126866.256581:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 307 00000100:00100000:3.0:1789126866.256598:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258827008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126866.256957:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258827264:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 567us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.256967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:1.0:1789126866.256994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:1.0:1789126866.257002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104028f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258827520:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126866.259726:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104028f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258827520:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2706us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.259745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:1.0:1789126866.259800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:1.0:1789126866.259818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258827136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126866.259910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258827136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 102us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.259917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:1.0:1789126866.259931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:1.0:1789126866.259939:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258827392:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126866.259967:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258827392:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.259988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:1.0:1789126866.260040:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827648 00000100:00100000:1.0:1789126866.260049:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827648 00000100:00100000:1.0:1789126866.260107:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827776 00000100:00100000:1.0:1789126866.260111:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827776 00000100:00100000:1.0:1789126866.260150:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126866.260157:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2390:x1876035258827648:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:1.0:1789126866.260184:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eaa78 00000100:00080000:1.0:1789126866.260196:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9941032b1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789126866.260287:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1789126866.260709:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126866.260711:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258827008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 4118us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126866.260723:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 307 00000100:00100000:1.0:1789126866.260928:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+2:2390:x1876035258827648:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 770us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.260938:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126866.260960:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1789126866.260968:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2390:x1876035258827776:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:1.0:1789126866.260987:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eaa7f 00000100:00080000:1.0:1789126866.260998:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9941032b5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789126866.261088:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789126866.261203:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+2:2390:x1876035258827776:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 234us (5074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126866.261221:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00080000:1.0:1789126866.261251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126866.261257:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126866.261261:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126866.261264:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789126866.262888:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789126866.302689:0:12787:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789126866.303000:0:12787:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126866.347471:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126867.371934:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126867.626841:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276726784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126867.626905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.627365:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276727168:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.627407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.627435:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276727680:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.627471:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276726912:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.627477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.627500:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276728192:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.627532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.627546:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789126867.627552:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276727296:0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.627572:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726784 00000100:00100000:2.0:1789126867.627585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126867.627589:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726784 00000100:00100000:2.0:1789126867.627606:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276727808:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.627626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.627638:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276728320:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.627666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126867.627673:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789126867.627684:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727168 00000100:00100000:1.0:1789126867.627686:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276726784:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126867.627688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727168 00000100:00100000:2.0:1789126867.627709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727680 00000100:00100000:2.0:1789126867.627711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727680 00002000:00000024:1.0:1789126867.627719:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126867.627723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728192 00000100:00100000:2.0:1789126867.627726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728192 00000100:00100000:2.0:1789126867.627739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727808 00000100:00100000:3.0:1789126867.627741:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727296 00000100:00100000:2.0:1789126867.627741:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727808 00000100:00100000:3.0:1789126867.627748:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727296 00000100:00100000:1.0:1789126867.627769:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276726784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.627771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728320 00000100:00100000:2.0:1789126867.627776:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728320 00000100:00100000:1.0:1789126867.627782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789126867.627794:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789126867.627796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789126867.627811:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276727168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126867.627812:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276727296:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789126867.627821:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126867.627826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126867.627830:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126867.627954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276727168:12345-0@lo:400:kworker.0 Request processed in 151us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126867.627959:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276727296:12345-0@lo:400:kworker.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.627963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789126867.627973:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789126867.627981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789126867.627989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104131e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276727680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.628011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104131e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276727680:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.628015:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789126867.628031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789126867.628036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276728192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.628067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276728192:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.628072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789126867.628084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789126867.628089:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276727808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628099:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.628107:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276727808:12345-0@lo:400:kworker.0 Request processed in 19us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.628112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789126867.628130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789126867.628134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.628142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276728320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628162:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276727936:0@lo:400:kworker.0 00000100:00100000:2.0:1789126867.628164:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276728320:12345-0@lo:400:kworker.0 Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.628172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789126867.628180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727424 00000100:00100000:2.0:1789126867.628182:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727424 00000100:00100000:2.0:1789126867.628194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789126867.628198:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236635a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276727424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126867.628227:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236635a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276727424:12345-0@lo:400:kworker.0 Request processed in 28us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126867.628232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789126867.628236:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276728448:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789126867.628285:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e78b40 x1876035276726784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126867.628300:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276726784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126867.628342:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276726912 00000100:00100000:3.0:1789126867.628347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276726912 00000100:00100000:1.0:1789126867.628381:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276727296:0@lo:400:kworker.0 00000100:00100000:3.0:1789126867.628387:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00010000:00080000:1.0:1789126867.628395:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647cb40 x1876035276727808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126867.628399:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276726912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.628414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276727808:0@lo:400:kworker.0 00010000:00080000:1.0:1789126867.628426:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647e580 x1876035276728320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126867.628434:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276728320:0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.628452:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276727680:0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.628469:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276728192:0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.628540:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276727168:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628683:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276727424:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628699:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789126867.628704:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276726912:12345-0@lo:400:kworker.0 Request processed in 307us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126867.628710:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276727040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126867.628716:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789126867.628743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126867.628773:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276727552:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126867.628818:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276728064:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126867.628858:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276726912:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.628885:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727936 00000100:00100000:0.0:1789126867.628889:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727936 00000100:00100000:2.0:1789126867.628890:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727040 00000100:00100000:2.0:1789126867.628896:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727040 00000100:00100000:0.0:1789126867.628934:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728448 00000100:00100000:0.0:1789126867.628939:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728448 00000100:00100000:2.0:1789126867.628950:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789126867.628956:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728064 00000100:00100000:2.0:1789126867.628961:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276727040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126867.628962:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728064 00002000:00000024:2.0:1789126867.628977:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126867.629028:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276727040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126867.629030:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126867.629039:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789126867.629046:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276727936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.629065:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789126867.629076:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236635e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276728448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.629089:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276727936:12345-0@lo:400:kworker.0 Request processed in 49us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126867.629102:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789126867.629119:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236635e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276728448:12345-0@lo:400:kworker.0 Request processed in 46us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126867.629121:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789126867.629134:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789126867.629135:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276728064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126867.629172:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276728064:12345-0@lo:400:kworker.0 Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126867.629178:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789126867.629210:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126867.629214:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789126867.629235:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa29680 x1876035276727040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126867.629249:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276727040:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789126867.629260:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647c3c0 x1876035276728064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126867.629268:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276728064:0@lo:400:kworker.0 00000100:00100000:3.0:1789126867.629399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276727552 00000100:00100000:3.0:1789126867.629404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276727552 00000100:00100000:3.0:1789126867.629441:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789126867.629458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276727552:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789126867.629502:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647da40 x1876035276727936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126867.629515:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276727936:0@lo:400:kworker.0 00010000:00080000:0.0:1789126867.629529:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647ed00 x1876035276728448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126867.629536:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276728448:0@lo:400:kworker.0 00000100:00100000:0.0:1789126867.629557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276727552:0@lo:400:kworker.0 00000100:00100000:3.0:1789126867.629997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276727552:12345-0@lo:400:kworker.0 Request processed in 537us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126867.630004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000020:00000004:2.0:1789126868.090046:0:12884:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789126868.090422:0:12884:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789126868.395514:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126869.421672:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126869.674786:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276728576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126869.674899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126869.675037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728576 00000100:00100000:3.0:1789126869.675050:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728576 00000100:00100000:3.0:1789126869.675160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789126869.675179:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276728576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126869.675248:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126869.675312:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276728576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126869.675320:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126869.675418:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276728576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126870.186950:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276728832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126870.187036:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126870.187107:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126870.187114:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276728704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126870.187141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126870.187179:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728832 00000100:00100000:1.0:1789126870.187187:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728832 00000100:00100000:1.0:1789126870.187237:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728704 00000100:00100000:1.0:1789126870.187240:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728704 00000100:00100000:1.0:1789126870.187258:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789126870.187278:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d85f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276728832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126870.187308:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126870.187354:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d85f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276728832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126870.187361:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789126870.187543:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789126870.187550:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276728704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126870.187560:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126870.187587:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276728704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126870.187603:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789126870.187621:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126870.187675:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103077c00 x1876035276728704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126870.187693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276728704:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789126870.187707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236634b40 x1876035276728832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126870.187717:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276728832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789126870.442956:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126871.211849:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276728960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126871.211989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126871.213723:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276728960 00000100:00100000:1.0:1789126871.213743:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276728960 00000100:00100000:1.0:1789126871.213842:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789126871.213865:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276728960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126871.213921:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126871.214011:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276728960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.214018:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789126871.214340:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276728960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126871.377379:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126871.377427:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126871.377464:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126871.377484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126871.377506:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126871.377532:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258827904 00000100:00100000:1.0:1789126871.377541:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258827904 00000100:00100000:1.0:1789126871.377608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 309 00000100:00100000:1.0:1789126871.377617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258827904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126871.377733:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258827904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 117us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.377744:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 309 00000100:00100000:1.0:1789126871.377778:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828032 00000100:00100000:1.0:1789126871.377782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828032 00000100:00100000:1.0:1789126871.377811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828288 00000100:00100000:1.0:1789126871.377813:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828288 00000100:00100000:1.0:1789126871.377824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828160 00000100:00100000:1.0:1789126871.377826:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828160 00000100:00100000:1.0:1789126871.377835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828416 00000100:00100000:1.0:1789126871.377837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828416 00000100:00100000:1.0:1789126871.377848:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1789126871.377869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258828032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126871.377900:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258828032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 46us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.377907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1789126871.377919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:1.0:1789126871.377925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258828288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126871.377948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258828288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.377953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:1.0:1789126871.377964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:1.0:1789126871.377970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258828160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126871.377996:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258828160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.378015:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:1.0:1789126871.378027:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:1.0:1789126871.378033:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258828416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126871.378058:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258828416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126871.378063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00080000:1.0:1789126871.378216:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126871.378222:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789126871.467547:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789126871.686434:0:13029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789126871.729386:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000020:00000080:1.0:1789126871.729395:0:8422:0:(genops.c:885:class_export_put()) final put ffff9941032b3000/55f22eda-f51b-4ffa-ab32-c741beec7900 00000020:00000080:1.0:1789126871.730633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b3000/55f22eda-f51b-4ffa-ab32-c741beec7900 for lustre-OST0000 00000020:00000080:1.0:1789126871.730698:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941032b1800 for lustre-OST0000 00000001:00100000:0.0:1789126871.730757:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000020:00000080:0.0:1789126871.730762:0:9505:0:(genops.c:885:class_export_put()) final put ffff9941032b6000/55f22eda-f51b-4ffa-ab32-c741beec7900 00000020:00000080:1.0:1789126871.731121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b6000/55f22eda-f51b-4ffa-ab32-c741beec7900 for lustre-OST0001 00000020:00000080:1.0:1789126871.731156:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941032b5000 for lustre-OST0001 00010000:00010000:0.0:1789126872.495716:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126872.746870:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276729088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126872.746943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.747359:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729088 00000100:00100000:2.0:1789126872.747369:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729088 00000100:00100000:3.0:1789126872.747426:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276729344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126872.747456:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789126872.747462:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.747472:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276729088:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126872.747489:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126872.747497:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276729216:0@lo:400:kworker.0 00002000:00000024:2.0:1789126872.747506:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126872.747528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126872.747568:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729344 00000100:00100000:2.0:1789126872.747570:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276729088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.747578:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789126872.747587:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729344 00000100:00080000:2.0:1789126872.747600:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789126872.747632:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423647f0c0 x1876035276729088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126872.747634:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789126872.747664:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276729344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126872.747673:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276729088:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126872.747678:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126872.747715:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276729344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.747720:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729216 00000100:00100000:3.0:1789126872.747724:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789126872.747726:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729216 00010000:00080000:3.0:1789126872.747759:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030761c0 x1876035276729344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126872.747763:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789126872.747775:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126872.747779:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276729344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126872.747816:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276729216:12345-0@lo:400:kworker.0 Request processed in 43us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126872.747833:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276729216:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.747836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789126872.748011:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789126872.748041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.749497:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9942366370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276729472:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.749556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.749591:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126872.749599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276729600:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.749623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.749679:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729600 00000100:00100000:2.0:1789126872.749686:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729600 00000100:00100000:2.0:1789126872.749738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789126872.749748:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276729600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.749814:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276729600:12345-0@lo:400:kworker.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.749822:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789126872.749860:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276729600:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.749899:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729728 00000100:00100000:2.0:1789126872.749903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729728 00000100:00100000:2.0:1789126872.749928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729472 00000100:00100000:2.0:1789126872.750107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729472 00000100:00100000:2.0:1789126872.750134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789126872.750142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276729728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750177:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276729728:12345-0@lo:400:kworker.0 Request processed in 36us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.750183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789126872.750195:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789126872.750201:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276729472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276729472:12345-0@lo:400:kworker.0 Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.750263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789126872.750404:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9942366370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276729472:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750438:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236635680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276729856:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.750506:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276730368:0@lo:400:kworker.0 00000100:00100000:0.0:1789126872.750515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729856 00000100:00100000:0.0:1789126872.750521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729856 00000100:00100000:2.0:1789126872.750534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.750557:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126872.750562:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9942366370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276730240:0@lo:400:kworker.0 00000100:00100000:0.0:1789126872.750569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789126872.750580:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276729856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.750619:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730368 00000100:00100000:2.0:1789126872.750624:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730368 00000100:00100000:2.0:1789126872.750680:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730240 00000100:00100000:2.0:1789126872.750684:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730240 00000100:00100000:2.0:1789126872.750704:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789126872.750711:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276730368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750758:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276730368:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126872.750767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276729856:12345-0@lo:400:kworker.0 Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126872.750773:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789126872.750809:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789126872.750819:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276730240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750830:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789126872.750855:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276730240:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.750857:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276729984:0@lo:400:kworker.0 00000100:00100000:0.0:1789126872.750869:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789126872.750896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126872.750897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126872.750916:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276730112:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.750927:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276730496:0@lo:400:kworker.0 00000100:00100000:0.0:1789126872.750949:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.750972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126872.750975:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276730624:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276729984 00000100:00100000:2.0:1789126872.751015:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276729984 00000100:00100000:0.0:1789126872.751019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126872.751052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730112 00000100:00100000:2.0:1789126872.751056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730112 00000100:00080000:0.0:1789126872.751069:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126872.751072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730496 00000100:00080000:0.0:1789126872.751074:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126872.751077:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730496 00000100:00100000:0.0:1789126872.751087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730624 00000100:00100000:0.0:1789126872.751092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730624 00000100:00100000:2.0:1789126872.751109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789126872.751120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276729984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126872.751125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789126872.751135:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276730112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751169:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276729984:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.751178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789126872.751186:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276730112:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126872.751194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789126872.751211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789126872.751220:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276730496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276730496:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126872.751261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789126872.751271:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789126872.751282:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276730624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126872.751317:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276730624:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126872.751323:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:1.0:1789126872.751366:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236636580 x1876035276730112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126872.751378:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276730112:0@lo:400:kworker.0 00010000:00080000:1.0:1789126872.751390:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa28f00 x1876035276730624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789126872.751406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126872.751420:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126872.751425:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276730624:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751447:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276729984:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751460:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276730496:0@lo:400:kworker.0 00010000:00080000:2.0:1789126872.751491:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9942366370c0 x1876035276730240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126872.751502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9942366370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276730240:0@lo:400:kworker.0 00010000:00080000:2.0:1789126872.751514:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa29a40 x1876035276730368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126872.751522:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276730368:0@lo:400:kworker.0 00000100:00100000:2.0:1789126872.751544:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236635680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276729856:0@lo:400:kworker.0 00000100:00100000:3.0:1789126872.753824:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276729728:0@lo:400:kworker.0 00010000:00010000:1.0:1789126873.514918:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126874.540770:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126874.799285:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276730752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126874.799428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126874.801690:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276730752 00000100:00100000:2.0:1789126874.801706:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276730752 00000100:00100000:2.0:1789126874.801790:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789126874.801801:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276730752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126874.801841:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126874.804527:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276730752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2721us (5092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126874.804550:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789126874.807054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276730752:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789126875.145917:0:13176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4b4d5e60 20000000:00000080:0.0:1789126875.145941:0:13176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9941032d2000 uarg=0000000000000000 20000000:01000000:0.0:1789126875.146007:0:13176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789126875.146016:0:13176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789126875.146022:0:13176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789126875.150064:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789126875.153510:0:13176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789126875.170847:0:13176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789126875.172460:0:13176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172485:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172493:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172499:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172504:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172511:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172517:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172541:0:13176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172585:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172598:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.172613:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276730880:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126875.172744:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172753:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 23 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.172763:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731008:0@lo:104: 00000100:00100000:2.0:1789126875.172803:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126875.172842:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.172850:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.172858:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731136:0@lo:104: 00000100:00100000:2.0:1789126875.172879:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.172910:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731008 00000100:00100000:2.0:1789126875.172916:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731008 00000100:00100000:2.0:1789126875.172959:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731136 00000100:00100000:2.0:1789126875.172963:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731136 00000100:00100000:2.0:1789126875.172977:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789126875.172985:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13176:x1876035276731008:12345-0@lo:104: 00010000:00010000:2.0:1789126875.172997:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173040:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126875.173046:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13176:x1876035276731008:12345-0@lo:104: Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.173053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789126875.173069:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789126875.173075:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731136:12345-0@lo:104: 00010000:00010000:2.0:1789126875.173083:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173116:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126875.173121:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731136:12345-0@lo:104: Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.173127:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789126875.173173:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173187:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 23 pid: 6505 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.173199:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731264:0@lo:104: 00000100:00100000:2.0:1789126875.173258:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.173298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731264 00000100:00100000:2.0:1789126875.173313:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731264 00000100:00100000:2.0:1789126875.173341:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789126875.173347:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731264:12345-0@lo:104: 00010000:00010000:2.0:1789126875.173355:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173388:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789126875.173405:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731264:12345-0@lo:104: Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.173410:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789126875.173438:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173446:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 23 pid: 6507 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.173458:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731392:0@lo:104: 00000100:00100000:2.0:1789126875.173494:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.173518:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731392 00000100:00100000:2.0:1789126875.173521:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731392 00000100:00100000:2.0:1789126875.173539:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126875.173544:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731392:12345-0@lo:104: 00010000:00010000:2.0:1789126875.173552:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173581:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789126875.173587:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13176:x1876035276731392:12345-0@lo:104: Request processed in 43us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.173595:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789126875.173631:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173640:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 12 pid: 6506 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.173678:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731520:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126875.173726:0:13176:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126875.173755:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731008:0@lo:104: 00000100:00100000:2.0:1789126875.173769:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731136:0@lo:104: 00000100:00100000:2.0:1789126875.173780:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731264:0@lo:104: 00000100:00100000:2.0:1789126875.173792:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731392:0@lo:104: 00010000:00010000:2.0:1789126875.173838:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789126875.173847:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173858:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126875.173864:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173876:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126875.173886:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126875.173893:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126875.173931:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173955:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126875.173985:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.173994:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666eaa47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa4e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174012:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789126875.174016:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174023:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126875.174026:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174033:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126875.174039:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126875.174043:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126875.174057:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174063:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126875.174077:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174083:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666eaa39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa40 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174097:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789126875.174100:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174105:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126875.174108:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174115:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126875.174120:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126875.174124:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126875.174139:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174145:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126875.174150:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174157:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666eaa2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa32 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174165:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126875.174168:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174183:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126875.174186:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174192:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126875.174198:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126875.174202:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126875.174215:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174220:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126875.174226:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174231:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589400/0xa840b4da666eaa1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa24 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174243:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126875.174245:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126875.174246:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126875.174257:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276731648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.174284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.174323:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126875.174329:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276732032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.174360:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.174384:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276731776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.174428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.174447:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126875.174452:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276731904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.174470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126875.174494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731648 00000100:00100000:2.0:1789126875.174497:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731648 00010000:00010000:2.0:1789126875.174517:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 24 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.174532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732032 00000100:00100000:2.0:1789126875.174534:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732032 00010000:00010000:2.0:1789126875.174545:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 25 pid: 6507 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.174554:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731776 00000100:00100000:2.0:1789126875.174556:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731776 00010000:00010000:2.0:1789126875.174564:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 26 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.174573:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276731904 00000100:00100000:2.0:1789126875.174576:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276731904 00010000:00010000:2.0:1789126875.174585:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 27 pid: 6505 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126875.174597:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126875.174604:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+27:3642:x1876035276731648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126875.174616:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126875.174620:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 27 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174635:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 27 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174669:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166b400/0xa840b4da666eaa4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa47 expref: 27 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174681:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126875.174710:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+26:3642:x1876035276731648:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.174716:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789126875.174729:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126875.174735:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+25:3642:x1876035276732032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126875.174742:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126875.174746:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 25 pid: 6507 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174753:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 25 pid: 6507 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174762:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ea00/0xa840b4da666eaa24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa1d expref: 25 pid: 6507 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174771:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126875.174792:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276732032:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.174798:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126875.174810:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126875.174815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276731776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126875.174828:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126875.174834:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174842:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174851:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589e00/0xa840b4da666eaa40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa39 expref: 23 pid: 6506 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174859:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126875.174886:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276731776:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.174891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126875.174904:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126875.174910:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+21:3639:x1876035276731904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126875.174917:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126875.174921:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 21 pid: 6505 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174929:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 21 pid: 6505 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174939:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eaa32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa2b expref: 21 pid: 6505 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126875.174948:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126875.174968:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+20:3639:x1876035276731904:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126875.174982:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126875.175011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276731904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.175019:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276731776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.175045:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276732032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126875.175052:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276731648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789126875.175181:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126875.175716:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126875.175724:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126875.196075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126875.196141:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276730880:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126875.196155:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1876035276731520:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126875.196171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1789126875.196194:0:13176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126875.196261:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828544 00000100:00100000:0.0:1789126875.196268:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828544 00000100:00100000:3.0:1789126875.196274:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828672 00000100:00100000:3.0:1789126875.196278:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828672 00010000:00010000:3.0:1789126875.196302:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 14 pid: 6506 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126875.196302:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 14 pid: 6505 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126875.196328:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1789126875.196337:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+14:2393:x1876035258828672:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126875.196351:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126875.196357:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 14 pid: 6506 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196390:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 14 pid: 6506 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196427:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589a00/0xa840b4da666eaa16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c297 expref: 14 pid: 6506 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196447:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126875.196523:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258828672:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 179us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126875.196535:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1789126875.196563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1789126875.196574:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:2394:x1876035258828544:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126875.196586:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126875.196594:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196609:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196625:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb600/0xa840b4da666eaa63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2d6 expref: 12 pid: 6505 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196642:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196702:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196743:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196753:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196762:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196772:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196781:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126875.196787:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196800:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196822:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126875.196837:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126875.196877:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2394:x1876035258828544:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 303us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126875.196888:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00010000:00010000:0.0:1789126875.199011:0:13176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126875.199048:0:13176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126875.199055:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2200/0xa840b4da666eaa86 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126875.306905:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126875.306936:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276732160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126875.307022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126875.307095:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276732288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126875.307138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126875.307187:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732160 00000100:00100000:0.0:1789126875.307195:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732160 00000100:00100000:1.0:1789126875.307202:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732288 00000100:00100000:1.0:1789126875.307209:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732288 00000100:00100000:1.0:1789126875.307270:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789126875.307278:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789126875.307283:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276732288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126875.307291:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276732160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789126875.307338:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789126875.311316:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126875.311463:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276732160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4168us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126875.311476:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789126875.311522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789126875.311945:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103074f00 x1876035276732160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126875.311971:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276732160:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789126875.313732:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276732288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126875.313756:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276732288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126875.313843:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276732288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6561us (6700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126875.313854:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1789126875.562801:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126876.333721:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126876.333748:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276732416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126876.333833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.333913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732416 00000100:00100000:1.0:1789126876.333921:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732416 00000100:00100000:1.0:1789126876.333967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789126876.333975:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276732416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126876.334010:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126876.334056:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276732416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126876.334063:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789126876.334108:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103077c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276732416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126876.498887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126876.498941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126876.498982:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126876.499007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126876.501966:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828928 00000100:00100000:3.0:1789126876.501981:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828928 00000100:00100000:3.0:1789126876.502076:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829184 00000100:00100000:3.0:1789126876.502080:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829184 00000100:00100000:3.0:1789126876.503344:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1789126876.503624:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258828928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126876.503861:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258828928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 501us (4980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.503870:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1789126876.503899:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829056 00000100:00100000:3.0:1789126876.503906:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829056 00000100:00100000:3.0:1789126876.503937:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1789126876.503948:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258829184:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126876.503953:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126876.503975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258828800 00000100:00100000:1.0:1789126876.503980:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258828800 00000100:00100000:3.0:1789126876.503985:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258829184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 38us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.503993:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1789126876.504008:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829312 00000100:00100000:3.0:1789126876.504012:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829312 00000100:00100000:1.0:1789126876.504020:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 311 00000100:00100000:1.0:1789126876.504029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258828800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126876.504050:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1789126876.504062:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258828800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (5078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.504063:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258829056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126876.504077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 311 00000100:00100000:3.0:1789126876.504101:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258829056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.504107:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:3.0:1789126876.504122:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:3.0:1789126876.504140:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258829312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126876.504177:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258829312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.504183:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00080000:1.0:1789126876.504303:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126876.504318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1789126876.526787:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126876.526798:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 7 10000000:01000000:2.0:1789126876.526803:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126876.526849:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126876.526860:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126876.526870:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126876.527025:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126876.527093:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126876.527145:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126876.529448:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732544 00000100:00100000:3.0:1789126876.529469:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732544 00000100:00100000:3.0:1789126876.529630:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789126876.529641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276732544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126876.529679:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126876.529698:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa8d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.529725:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.529736:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.529745:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f000, rc 0) 00000100:00100000:3.0:1789126876.529825:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.529832:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789126876.532340:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126876.532379:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.532406:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126876.532485:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.532546:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126876.532590:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126876.532694:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732672 00000100:00100000:1.0:1789126876.532701:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732672 00000100:00100000:1.0:1789126876.532752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789126876.532762:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.532878:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126876.532897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789126876.534050:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.534097:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.534150:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126876.534187:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126876.534241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732800 00000100:00100000:1.0:1789126876.534247:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732800 00000100:00100000:1.0:1789126876.534287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789126876.534295:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.534426:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126876.534433:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789126876.534511:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789126876.537292:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789126876.538162:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789126876.538195:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126876.538206:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.538218:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126876.538230:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126876.538233:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 7 10000000:01000000:1.0:1789126876.538236:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126876.538278:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.538286:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.538298:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126876.538322:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.538416:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.538464:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126876.538524:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276732928 00000100:00100000:0.0:1789126876.538531:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276732928 00000100:00100000:0.0:1789126876.538585:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789126876.538594:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276732928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126876.538605:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126876.538618:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaa9b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.538641:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.538680:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.538697:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cbe00, rc 0) 00000100:00100000:0.0:1789126876.538738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276732928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126876.538752:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789126876.541344:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276732928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126876.541392:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.541405:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126876.541519:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.541586:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.541631:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126876.543277:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733056 00000100:00100000:0.0:1789126876.543286:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733056 00000100:00100000:0.0:1789126876.543343:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789126876.543353:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276733056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.543524:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276733056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126876.543532:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789126876.543638:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.543706:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.543755:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.543785:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126876.543872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733184 00000100:00100000:0.0:1789126876.543877:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733184 00000100:00100000:0.0:1789126876.543902:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789126876.543908:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276733184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.543980:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276733184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126876.543987:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789126876.544350:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789126876.546030:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789126876.546227:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789126876.546249:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126876.546260:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.546272:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126876.546283:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789126876.546286:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 7 10000000:01000000:0.0:1789126876.546289:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789126876.546329:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.546353:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.546365:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126876.546400:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104068780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.546477:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126876.546526:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45780 going to sleep for 11 seconds 00000100:00100000:1.0:1789126876.547015:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733312 00000100:00100000:1.0:1789126876.547023:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733312 00000100:00100000:1.0:1789126876.547077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789126876.547086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276733312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126876.547101:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126876.547115:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaaa9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.547139:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.547149:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.547159:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166b800, rc 0) 00000100:00100000:1.0:1789126876.547277:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126876.547295:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789126876.547970:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104068780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126876.547990:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.548001:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126876.548080:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.548127:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126876.548200:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126876.548236:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733440 00000100:00100000:0.0:1789126876.548241:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733440 00000100:00100000:0.0:1789126876.548311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789126876.548320:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126876.548445:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126876.548453:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789126876.548506:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.548533:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.548571:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126876.548628:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126876.548682:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733568 00000100:00100000:1.0:1789126876.548687:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733568 00000100:00100000:1.0:1789126876.548719:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789126876.548727:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.548797:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126876.548804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789126876.548909:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789126876.549832:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789126876.550094:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789126876.550119:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126876.550128:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.550139:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126876.550148:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126876.550151:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 7 10000000:01000000:1.0:1789126876.550153:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126876.550182:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.550189:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.550199:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126876.550219:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.550271:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.550310:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126876.550357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733696 00000100:00100000:3.0:1789126876.550363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733696 00000100:00100000:3.0:1789126876.550406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789126876.550414:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276733696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126876.550424:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126876.550436:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaab7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.550457:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.550467:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.550476:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ec00, rc 0) 00000100:00100000:3.0:1789126876.550509:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276733696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.550515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789126876.550586:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126876.550598:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126876.550606:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126876.550679:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126876.550714:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126876.550727:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126876.550818:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733824 00000100:00100000:3.0:1789126876.550829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733824 00000100:00100000:3.0:1789126876.550912:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789126876.550919:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276733824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.551015:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276733824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.551022:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789126876.551050:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa28f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.551075:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.551109:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126876.551128:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126876.551138:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276733952 00000100:00100000:3.0:1789126876.551141:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276733952 00000100:00100000:3.0:1789126876.551158:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789126876.551164:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276733952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126876.551230:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276733952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126876.551237:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789126876.551273:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276733952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789126876.554065:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789126876.554326:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789126876.554352:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126876.554365:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126876.554377:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126876.602034:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126877.202365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126877.202426:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829440 00000100:00100000:1.0:1789126877.202437:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829440 00000100:00100000:1.0:1789126877.202498:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 324 00000100:00100000:1.0:1789126877.202510:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:6161:x1876035258829440:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126877.202532:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126877.202557:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c307 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126877.202595:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126877.202611:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126877.202622:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166ac00, rc 0) 00000100:00100000:1.0:1789126877.203047:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829440:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 539us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126877.203055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 324 00000100:00100000:1.0:1789126877.209022:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126877.209930:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829568 00000100:00100000:0.0:1789126877.209940:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829568 00000100:00100000:0.0:1789126877.209997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 325 00000100:00100000:0.0:1789126877.210014:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829568:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126877.210156:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829568:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 143us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126877.210164:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 325 00000100:00100000:1.0:1789126877.215116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126877.215326:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829696 00000100:00100000:3.0:1789126877.215336:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829696 00000100:00100000:3.0:1789126877.215398:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 326 00000100:00100000:3.0:1789126877.215407:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829696:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126877.215542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829696:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 135us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.215555:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 326 00000100:00100000:3.0:1789126877.227758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126877.227911:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829824 00000100:00100000:0.0:1789126877.227920:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829824 00000100:00100000:0.0:1789126877.227979:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 327 00000100:00100000:0.0:1789126877.227989:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258829824:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126877.228005:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126877.228022:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c30e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126877.228049:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126877.228060:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126877.228069:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca800, rc 0) 00000100:00100000:0.0:1789126877.228127:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258829824:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 139us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126877.228134:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 327 00000100:00100000:2.0:1789126877.238735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126877.238775:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258829952 00000100:00100000:3.0:1789126877.238785:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258829952 00000100:00100000:3.0:1789126877.238858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 328 00000100:00100000:3.0:1789126877.238867:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258829952:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126877.239018:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258829952:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.239026:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 328 00000100:00100000:0.0:1789126877.243055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126877.243260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830080 00000100:00100000:2.0:1789126877.243270:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830080 00000100:00100000:2.0:1789126877.243318:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 329 00000100:00100000:2.0:1789126877.243328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258830080:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126877.243471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258830080:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 144us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126877.243480:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 329 00010000:00010000:0.0:1789126877.612070:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126877.866862:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126877.866898:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276734080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126877.867003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126877.867508:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734080 00000100:00100000:1.0:1789126877.867520:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734080 00000100:00100000:1.0:1789126877.867588:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789126877.867601:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276734080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126877.867630:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126877.867735:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276734080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126877.867744:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789126877.867853:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126877.869532:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276734336:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.869625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.869710:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276734848:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.869734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.869758:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276735360:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.869780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.869975:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789126877.869982:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276734464:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.870090:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276734976:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126877.870128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276734592:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870151:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276735488:0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.870205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.870230:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734336 00000100:00100000:3.0:1789126877.870240:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734336 00000100:00100000:1.0:1789126877.870259:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735104:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870297:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734848 00000100:00100000:3.0:1789126877.870305:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734848 00000100:00100000:1.0:1789126877.870306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126877.870339:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735616:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870344:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735360 00000100:00100000:3.0:1789126877.870350:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735360 00000100:00100000:3.0:1789126877.870383:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734976 00000100:00100000:3.0:1789126877.870389:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734976 00000100:00100000:1.0:1789126877.870397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.870421:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734592 00000100:00100000:3.0:1789126877.870427:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734592 00000100:00100000:3.0:1789126877.870459:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789126877.870471:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.870474:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789126877.870487:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276734208:0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.870531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.870558:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276734336:12345-0@lo:400:kworker.0 Request processed in 88us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.870569:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789126877.870573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276734720:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870601:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789126877.870615:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276734848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.870618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.870696:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276734848:12345-0@lo:400:kworker.0 Request processed in 85us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.870703:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789126877.870714:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789126877.870720:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276735360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870758:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276735360:12345-0@lo:400:kworker.0 Request processed in 38us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.870764:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789126877.870775:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789126877.870780:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276734976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870832:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276734976:12345-0@lo:400:kworker.0 Request processed in 52us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.870838:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789126877.870852:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789126877.870860:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276734592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.870891:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276734592:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.870897:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1789126877.870925:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126877.870930:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789126877.870966:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236634000 x1876035276734080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126877.870991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276734080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126877.871028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126877.871072:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276734336:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.871086:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276734848:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.871096:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276735360:0@lo:400:kworker.0 00010000:00080000:3.0:1789126877.871127:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80780 x1876035276734976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126877.871135:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734464 00000100:00100000:3.0:1789126877.871137:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276734976:0@lo:400:kworker.0 00000100:00100000:0.0:1789126877.871144:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734464 00000100:00100000:1.0:1789126877.871163:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276735232:0@lo:400:kworker.0 00000100:00100000:3.0:1789126877.871166:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735488 00000100:00100000:3.0:1789126877.871172:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735488 00000100:00100000:0.0:1789126877.871196:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734720 00000100:00100000:0.0:1789126877.871203:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734720 00000100:00100000:3.0:1789126877.871219:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789126877.871241:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276735488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.871242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126877.871243:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789126877.871263:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.871287:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126877.871310:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276735488:12345-0@lo:400:kworker.0 Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.871320:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789126877.871325:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276734464:12345-0@lo:400:kworker.0 Request processed in 66us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126877.871334:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789126877.871343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126877.871357:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789126877.871369:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276734464:0@lo:400:kworker.0 00010000:00080000:3.0:1789126877.871393:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ec7840 x1876035276735488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126877.871403:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276735488:0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.871848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126877.871884:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276734720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.871909:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276734592:0@lo:400:kworker.0 00000100:00100000:0.0:1789126877.871953:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276734720:12345-0@lo:400:kworker.0 Request processed in 587us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126877.871958:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735104 00000100:00100000:0.0:1789126877.871965:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789126877.871968:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735104 00000100:00100000:0.0:1789126877.872004:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735616 00000100:00100000:0.0:1789126877.872011:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735616 00000100:00100000:1.0:1789126877.872041:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735232 00000100:00100000:1.0:1789126877.872048:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735232 00000100:00100000:0.0:1789126877.872064:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789126877.872080:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.872094:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789126877.872109:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126877.872129:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735104:12345-0@lo:400:kworker.0 Request processed in 53us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126877.872139:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789126877.872163:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789126877.872174:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276735232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.872182:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735616:12345-0@lo:400:kworker.0 Request processed in 76us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126877.872194:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789126877.872227:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126877.872228:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276735232:12345-0@lo:400:kworker.0 Request processed in 55us (998us total) trans 0 rc 0/0 00000100:00080000:3.0:1789126877.872235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126877.872243:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789126877.872258:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276734720:0@lo:400:kworker.0 00010000:00080000:1.0:1789126877.872278:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80b40 x1876035276735232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126877.872281:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276734208 00000100:00100000:0.0:1789126877.872291:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276734208 00000100:00100000:0.0:1789126877.872334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789126877.872353:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276734208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126877.872410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276734208:12345-0@lo:400:kworker.0 Request processed in 60us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126877.872417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789126877.872475:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735744 00000100:00100000:3.0:1789126877.872481:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735744 00000100:00100000:3.0:1789126877.872514:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789126877.872524:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126877.872544:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126877.872583:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276735744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126877.872588:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789126877.874232:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276735232:0@lo:400:kworker.0 00010000:00080000:1.0:1789126877.874287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410406bc00 x1876035276735744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126877.874361:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735744:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789126877.874385:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa81e00 x1876035276735104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126877.874395:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735104:0@lo:400:kworker.0 00010000:00080000:1.0:1789126877.874407:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ec6580 x1876035276735616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126877.874428:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276735616:0@lo:400:kworker.0 00000100:00100000:1.0:1789126877.874467:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276734208:0@lo:400:kworker.0 00010000:00010000:0.0:1789126878.639415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789126878.753698:0:13375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789126879.659551:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126879.916715:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276735872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126879.916821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126879.917022:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276735872 00000100:00100000:2.0:1789126879.917032:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276735872 00000100:00100000:2.0:1789126879.917098:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789126879.917110:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276735872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126879.917153:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126879.917842:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276735872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126879.919293:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276735872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2173us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126879.919310:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789126880.429515:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276736000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789126880.429604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126880.429669:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736000 00000100:00100000:1.0:1789126880.429680:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736000 00000100:00100000:1.0:1789126880.429762:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789126880.429777:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276736000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126880.429823:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126880.429885:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276736000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126880.429894:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789126880.429901:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789126880.429928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402bc00 x1876035276736000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126880.429952:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276736000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789126880.430064:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126880.430076:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276736128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126880.430164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126880.430201:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736128 00000100:00100000:3.0:1789126880.430206:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736128 00000100:00100000:3.0:1789126880.430256:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789126880.430264:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276736128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126880.430276:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789126880.430285:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789126880.430338:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402ad00 x1876035276736128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126880.430353:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276736128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126880.430445:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276736128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126880.430455:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1789126880.682878:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126881.451510:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126881.451533:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104029680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276736256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126881.451625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126881.452482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736256 00000100:00100000:1.0:1789126881.452491:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736256 00000100:00100000:1.0:1789126881.452548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789126881.452558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276736256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126881.452591:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126881.452673:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276736256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126881.452680:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789126881.452965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104029680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276736256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126881.614678:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126881.614722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126881.614756:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126881.614895:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830208 00000100:00100000:2.0:1789126881.614905:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830208 00000100:00100000:2.0:1789126881.614957:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 331 00000100:00100000:2.0:1789126881.614967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258830208:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126881.615035:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258830208:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126881.615043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 331 00000100:00100000:3.0:1789126881.615221:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126881.615875:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126881.615960:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830464 00000100:00100000:0.0:1789126881.615966:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830464 00000100:00100000:0.0:1789126881.616011:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830720 00000100:00100000:0.0:1789126881.616015:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830720 00000100:00100000:0.0:1789126881.616028:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830336 00000100:00100000:0.0:1789126881.616030:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830336 00000100:00100000:0.0:1789126881.616045:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:0.0:1789126881.616053:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258830464:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126881.616108:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258830464:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 56us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126881.616115:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:0.0:1789126881.616129:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1789126881.616136:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258830720:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126881.616160:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258830720:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126881.616166:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1789126881.616194:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:0.0:1789126881.616200:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258830336:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126881.616224:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258830336:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126881.616231:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00080000:0.0:1789126881.616739:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789126881.616744:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126881.617042:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830592 00000100:00100000:0.0:1789126881.617048:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830592 00000100:00100000:0.0:1789126881.617099:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:0.0:1789126881.617106:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258830592:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126881.617148:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258830592:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126881.617155:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00080000:1.0:1789126881.618049:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789126881.711602:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126882.730917:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126882.986871:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276736384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126882.986958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.987057:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736384 00000100:00100000:1.0:1789126882.987066:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736384 00000100:00100000:1.0:1789126882.987126:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789126882.987136:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104028780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276736384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126882.987176:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126882.987229:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104028780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276736384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.987237:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789126882.987259:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789126882.987290:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402a940 x1876035276736384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.987310:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276736384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126882.988101:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276736512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126882.988158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.988208:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736512 00000100:00100000:1.0:1789126882.988215:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736512 00000100:00100000:1.0:1789126882.988266:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789126882.988274:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104029680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276736512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126882.988292:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126882.988330:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104029680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276736512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.988348:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789126882.988368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789126882.988392:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402a940 x1876035276736512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.988407:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276736512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126882.988547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276736640:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.988579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.988622:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276737152:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.988671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.989632:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276737664:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.996867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.996934:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789126882.996948:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276736768:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.996981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997003:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276737280:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997047:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276737792:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997115:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736640 00000100:00100000:1.0:1789126882.997123:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736640 00000100:00100000:1.0:1789126882.997175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789126882.997183:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276736640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997238:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276736640:12345-0@lo:400:kworker.0 Request processed in 56us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997245:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789126882.997280:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737152 00000100:00100000:1.0:1789126882.997284:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737152 00000100:00100000:1.0:1789126882.997309:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126882.997316:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276737152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997359:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276737152:12345-0@lo:400:kworker.0 Request processed in 44us (8711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997364:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126882.997382:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737664 00000100:00100000:1.0:1789126882.997393:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737664 00000100:00100000:1.0:1789126882.997427:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789126882.997434:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276737664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997468:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276737664:12345-0@lo:400:kworker.0 Request processed in 35us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997474:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789126882.997493:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736768 00000100:00100000:1.0:1789126882.997496:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736768 00000100:00100000:1.0:1789126882.997521:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737280 00000100:00100000:1.0:1789126882.997524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737280 00000100:00100000:1.0:1789126882.997538:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737792 00000100:00100000:1.0:1789126882.997541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737792 00000100:00100000:1.0:1789126882.997556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789126882.997561:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276736768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276736768:12345-0@lo:400:kworker.0 Request processed in 44us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789126882.997626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789126882.997633:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276737280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276737280:12345-0@lo:400:kworker.0 Request processed in 44us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789126882.997756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789126882.997761:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276737792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997783:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276737792:12345-0@lo:400:kworker.0 Request processed in 23us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.997786:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1789126882.997814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126882.997817:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126882.997826:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276737024:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997858:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276737536:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997882:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789126882.997886:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276736896:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997910:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276737408:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997928:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276737920:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.997937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126882.997950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737024 00000100:00100000:1.0:1789126882.997952:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737024 00000100:00100000:1.0:1789126882.997962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737408 00000100:00100000:1.0:1789126882.997963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737408 00000100:00100000:1.0:1789126882.997975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737920 00000100:00100000:1.0:1789126882.997978:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737920 00000100:00100000:1.0:1789126882.997991:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789126882.997996:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998028:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276737024:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.998034:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789126882.998048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789126882.998054:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276737408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998080:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276737408:12345-0@lo:400:kworker.0 Request processed in 27us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.998093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789126882.998106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789126882.998112:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276737920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276737920:12345-0@lo:400:kworker.0 Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.998147:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789126882.998163:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276737536 00000100:00100000:1.0:1789126882.998167:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276737536 00000100:00100000:1.0:1789126882.998195:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789126882.998201:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276737536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998229:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276737536:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.998234:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789126882.998250:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276736896 00000100:00100000:1.0:1789126882.998252:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276736896 00000100:00100000:1.0:1789126882.998271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789126882.998277:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276736896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998305:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276736896:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126882.998311:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1789126882.998331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126882.998334:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126882.998373:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276736896:0@lo:400:kworker.0 00010000:00080000:1.0:1789126882.998385:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104307c00 x1876035276737408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.998394:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276737408:0@lo:400:kworker.0 00010000:00080000:1.0:1789126882.998412:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104305e00 x1876035276737920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.998420:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276737920:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998430:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276737024:0@lo:400:kworker.0 00010000:00080000:1.0:1789126882.998438:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104304f00 x1876035276737536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.998446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276737536:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998485:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276736768:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998496:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276737280:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998507:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276737792:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998516:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276736640:0@lo:400:kworker.0 00000100:00100000:1.0:1789126882.998525:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276737152:0@lo:400:kworker.0 00010000:00080000:1.0:1789126882.998535:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104305a40 x1876035276737664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126882.998544:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276737664:0@lo:400:kworker.0 00010000:00010000:0.0:1789126883.757016:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126884.780881:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126885.034873:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276738048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126885.034950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126885.035134:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738048 00000100:00100000:0.0:1789126885.035142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738048 00000100:00100000:0.0:1789126885.035195:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789126885.035204:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276738048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126885.035241:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126885.035300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276738048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126885.035307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789126885.035461:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276738048:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1789126885.440266:0:13668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff67936130 20000000:00000080:3.0:1789126885.440283:0:13668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9941032bd400 uarg=0000000000000000 20000000:01000000:3.0:1789126885.440477:0:13668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789126885.440484:0:13668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789126885.440489:0:13668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:1.0:1789126885.441003:0:13669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789126885.441162:0:13668:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789126885.455764:0:13668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789126885.455801:0:13668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:2.0:1789126885.455818:0:13668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:2.0:1789126885.455844:0:13668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789126885.456123:0:13668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456145:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456155:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456163:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456240:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456251:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456723:0:13668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456732:0:13668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456773:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.456789:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 12 pid: 6507 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.456806:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738176:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126885.457298:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.457307:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.457315:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738304:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126885.457362:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.457370:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 23 pid: 6506 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.457379:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738432:0@lo:104: 00000100:00100000:2.0:1789126885.457442:0:13668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126885.457487:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.457496:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.457504:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738560:0@lo:104: 00010000:00010000:2.0:1789126885.457529:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.457537:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.457545:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738688:0@lo:104: 00010000:00010000:2.0:1789126885.457569:0:13668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.457576:0:13668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 23 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.457583:0:13668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738816:0@lo:104: 00000100:00100000:2.0:1789126885.457600:0:13668:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e2bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1789126885.459557:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789126885.459600:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126885.459641:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126885.459695:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738432 00000100:00100000:2.0:1789126885.459704:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738432 00000100:00100000:3.0:1789126885.459711:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126885.459722:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738560 00000100:00100000:3.0:1789126885.459726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738560 00000100:00100000:2.0:1789126885.459754:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738688 00000100:00100000:3.0:1789126885.459755:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738816 00000100:00100000:2.0:1789126885.459759:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738688 00000100:00100000:3.0:1789126885.459760:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738816 00000100:00100000:2.0:1789126885.459787:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126885.459798:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:13668:x1876035276738432:12345-0@lo:104: 00010000:00010000:2.0:1789126885.459816:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.460164:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789126885.460363:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126885.460369:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.460383:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126885.460387:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.460396:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126885.460403:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126885.460409:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126885.460449:0:9515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.460456:0:9515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126885.460476:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.460483:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eaab7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaabe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.460496:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126885.460499:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126885.460501:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126885.460523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276738944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126885.460561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126885.460614:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276738944 00000100:00100000:0.0:1789126885.460619:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276738944 00010000:00010000:0.0:1789126885.460643:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 24 pid: 6506 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.460692:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+6:13668:x1876035276738432:12345-0@lo:104: Request processed in 376us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126885.462220:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126885.462234:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276738944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126885.462250:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126885.462268:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 24 pid: 6506 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.462279:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 24 pid: 6506 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.462300:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126885.462381:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276738944:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126885.462388:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1789126885.462472:0:13668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ec00/0xa840b4da666eaabe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaab7 expref: 23 pid: 6506 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126885.462484:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738432:0@lo:104: 00000100:00100000:1.0:1789126885.462538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276738944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789126885.465545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126885.465635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126885.465697:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830848 00000100:00100000:3.0:1789126885.465707:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830848 00010000:00010000:3.0:1789126885.465755:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 13 pid: 6507 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126885.465787:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258830976 00000100:00100000:3.0:1789126885.465790:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258830976 00010000:00010000:3.0:1789126885.465801:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 14 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126885.465822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1789126885.465831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c860d42f-307d-4b4b-a338-6aeff2da97ec+14:2393:x1876035258830848:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126885.465845:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126885.465851:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 14 pid: 6507 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126885.465865:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 14 pid: 6507 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126885.465890:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126885.465921:0:13668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca800/0xa840b4da666eaacc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c30e expref: 14 pid: 6507 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126885.465943:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738176:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126885.465950:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258830848:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 118us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126885.465960:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1789126885.465961:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738304:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126885.465996:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1789126885.466004:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:2393:x1876035258830976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126885.466013:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126885.466018:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126885.466029:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126885.466041:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166ac00/0xa840b4da666eaac5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c307 expref: 12 pid: 6506 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126885.466052:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126885.466072:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258830976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 68us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126885.466080:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:2.0:1789126885.466490:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789126885.466551:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126885.466561:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13668:x1876035276738560:12345-0@lo:104: 00010000:00010000:2.0:1789126885.466575:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.466672:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126885.466678:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13668:x1876035276738560:12345-0@lo:104: Request processed in 121us (7080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126885.466685:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789126885.466700:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126885.466707:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13668:x1876035276738688:12345-0@lo:104: 00010000:00010000:2.0:1789126885.466716:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126885.466761:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789126885.466767:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13668:x1876035276738688:12345-0@lo:104: Request processed in 61us (7125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126885.466773:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789126885.466785:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789126885.466792:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13668:x1876035276738816:12345-0@lo:104: 00010000:00010000:2.0:1789126885.466800:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.466973:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789126885.466982:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126885.466987:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738560:0@lo:104: 00010000:00010000:1.0:1789126885.466998:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc132ec20) 00000100:00100000:0.0:1789126885.467003:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738688:0@lo:104: 10000000:00010000:1.0:1789126885.467004:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126885.467013:0:13668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13668:1876035276738816:0@lo:104: 00010000:00010000:1.0:1789126885.467018:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126885.467027:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126885.467033:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126885.467066:0:13668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467075:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467091:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126885.467116:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467124:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364cbc00/0xa840b4da666eaaa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaab0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467137:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789126885.467141:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467147:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126885.467156:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467163:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126885.467170:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126885.467176:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126885.467204:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467210:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126885.467226:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467231:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a400/0xa840b4da666eaa9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaa2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467246:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126885.467249:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467255:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126885.467258:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467264:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126885.467280:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126885.467286:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789126885.467288:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126885.467311:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467318:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126885.467334:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467341:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666eaa8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaa94 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.467354:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126885.467355:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126885.467357:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126885.467371:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276739072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126885.467373:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789126885.467381:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13668:x1876035276738816:12345-0@lo:104: Request processed in 589us (7669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126885.467388:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789126885.467409:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126885.467422:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276739200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126885.467423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126885.467460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126885.467488:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276739328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126885.467500:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739072 00000100:00100000:2.0:1789126885.467507:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739072 00000100:00100000:1.0:1789126885.467515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126885.467531:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 23 pid: 6505 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126885.467555:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739200 00000100:00100000:2.0:1789126885.467563:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739200 00010000:00010000:2.0:1789126885.467576:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 24 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126885.468215:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739328 00000100:00100000:1.0:1789126885.468221:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739328 00010000:00010000:1.0:1789126885.468241:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 25 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126885.468259:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126885.468266:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+25:3642:x1876035276739072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126885.468286:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126885.468358:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 25 pid: 6505 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468370:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 25 pid: 6505 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468436:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166b800/0xa840b4da666eaab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaaa9 expref: 25 pid: 6505 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468506:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126885.468604:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276739072:12345-0@lo:103:ldlm_bl.0 Request processed in 337us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126885.468620:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126885.468635:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126885.468642:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276739200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126885.468667:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126885.468672:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468680:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468690:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaaa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa9b expref: 23 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468700:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126885.468730:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276739200:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126885.468745:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126885.468758:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789126885.468763:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+21:3640:x1876035276739328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126885.468771:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126885.468776:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 21 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468784:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 21 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468794:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f000/0xa840b4da666eaa94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaa8d expref: 21 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468805:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468814:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468829:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468836:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468841:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468848:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468862:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126885.468866:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468873:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468887:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126885.468897:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126885.468925:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+20:3640:x1876035276739328:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126885.468931:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789126885.468966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276739328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126885.469459:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276739200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126885.471709:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276739072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126885.471764:0:13668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.471777:0:13668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126885.471784:0:13668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2800/0xa840b4da666eaad3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126885.547844:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276739456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126885.547919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126885.548982:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276739584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126885.549035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126885.549098:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739456 00000100:00100000:3.0:1789126885.549105:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739456 00000100:00100000:3.0:1789126885.549154:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739584 00000100:00100000:3.0:1789126885.549157:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739584 00000100:00100000:3.0:1789126885.549173:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789126885.549181:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276739456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126885.549569:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126885.553817:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276739456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4625us (5887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126885.553850:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789126885.553886:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789126885.553899:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276739584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126885.553925:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126885.554010:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276739584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (4976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126885.554016:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789126885.554039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789126885.556823:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec21c0 x1876035276739584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126885.556849:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276739584:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789126885.557071:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043db840 x1876035276739456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126885.557086:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276739456:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789126885.804521:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126886.542718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126886.542864:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831104 00000100:00100000:2.0:1789126886.542874:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831104 00000100:00100000:2.0:1789126886.542933:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 333 00000100:00100000:2.0:1789126886.542943:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:6161:x1876035258831104:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126886.542961:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126886.542981:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c315 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.543021:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.543046:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.543056:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126886.543122:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831104:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 181us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.543130:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 333 00000100:00100000:0.0:1789126886.546054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126886.551217:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831232 00000100:00100000:1.0:1789126886.551233:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831232 00000100:00100000:1.0:1789126886.551312:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 334 00000100:00100000:1.0:1789126886.551334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831232:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.551524:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831232:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 192us (5544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.551532:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 334 00000100:00100000:3.0:1789126886.555412:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126886.556933:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831360 00000100:00100000:2.0:1789126886.556951:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831360 00000100:00100000:2.0:1789126886.557193:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 335 00000100:00100000:2.0:1789126886.557209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831360:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.558020:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831360:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 808us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.558032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 335 00000100:00100000:3.0:1789126886.562620:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.562964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831488 00000100:00100000:0.0:1789126886.562978:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831488 00000100:00100000:0.0:1789126886.563966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 336 00000100:00100000:0.0:1789126886.563987:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10308:x1876035258831488:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789126886.564248:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10308:x1876035258831488:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 269us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.564257:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 336 00000100:00100000:0.0:1789126886.569821:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126886.570184:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831616 00000100:00100000:2.0:1789126886.570199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831616 00000100:00100000:2.0:1789126886.570279:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 337 00000100:00100000:2.0:1789126886.570292:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10308:x1876035258831616:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789126886.570949:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10308:x1876035258831616:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 657us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.570960:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 337 00000100:00100000:2.0:1789126886.571608:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276739712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126886.571719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126886.572056:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739712 00000100:00100000:3.0:1789126886.572067:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739712 00000100:00100000:3.0:1789126886.572143:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789126886.572155:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276739712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126886.572220:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789126886.578929:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276739712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6756us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.578954:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789126886.579390:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276739712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126886.579718:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.579831:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831744 00000100:00100000:0.0:1789126886.579842:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831744 00000100:00100000:0.0:1789126886.579939:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 338 00000100:00100000:0.0:1789126886.579953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258831744:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126886.579977:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126886.580009:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c31c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.580058:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.580072:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.580087:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb200, rc 0) 00000100:00100000:0.0:1789126886.580198:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258831744:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.580214:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 338 00000100:00100000:3.0:1789126886.582323:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126886.582640:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258831872 00000100:00100000:2.0:1789126886.582703:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258831872 00000100:00100000:2.0:1789126886.582781:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 339 00000100:00100000:2.0:1789126886.582795:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258831872:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.583235:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258831872:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 441us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.583246:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 339 00000100:00100000:2.0:1789126886.594043:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.594274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832000 00000100:00100000:0.0:1789126886.594289:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832000 00000100:00100000:0.0:1789126886.594384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 340 00000100:00100000:0.0:1789126886.594396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258832000:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.595010:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258832000:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 612us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.595030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 340 00000100:00100000:3.0:1789126886.606505:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126886.607411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832128 00000100:00100000:2.0:1789126886.607428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832128 00000100:00100000:2.0:1789126886.607630:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 341 00000100:00100000:2.0:1789126886.607643:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10311:x1876035258832128:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789126886.607936:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10311:x1876035258832128:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 294us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.607947:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 341 00000100:00100000:3.0:1789126886.612240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126886.627640:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832256 00000100:00100000:1.0:1789126886.630731:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832256 00000100:00100000:1.0:1789126886.630835:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 342 00000100:00100000:1.0:1789126886.630847:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10311:x1876035258832256:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789126886.631038:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10311:x1876035258832256:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 193us (18815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.631047:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 342 00000100:00100000:0.0:1789126886.734812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.734872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.734940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.734967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126886.735014:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832384 00000100:00100000:0.0:1789126886.735030:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832384 00000100:00100000:0.0:1789126886.735133:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832512 00000100:00100000:0.0:1789126886.735137:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832512 00000100:00100000:0.0:1789126886.735155:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832640 00000100:00100000:0.0:1789126886.735158:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832640 00000100:00100000:0.0:1789126886.735239:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832768 00000100:00100000:0.0:1789126886.735242:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832768 00000100:00100000:0.0:1789126886.735263:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:0.0:1789126886.735275:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258832384:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126886.735465:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258832384:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 192us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.735475:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:0.0:1789126886.735498:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1789126886.735505:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258832512:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126886.735534:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258832512:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.735539:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1789126886.735551:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:0.0:1789126886.735558:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258832640:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:2.0:1789126886.736987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126886.737001:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126886.737419:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258832640:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1854us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.737431:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:0.0:1789126886.737462:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:0.0:1789126886.737492:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258832768:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126886.737524:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258832768:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126886.737530:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00010000:00010000:3.0:1789126886.828761:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789126886.955452:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789126886.955464:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 7 10000000:01000000:0.0:1789126886.955470:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789126886.955538:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.955552:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.955564:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126886.955597:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104069e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276739840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.955730:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.955947:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.957763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739840 00000100:00100000:1.0:1789126886.957782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739840 00000100:00100000:1.0:1789126886.957878:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789126886.957893:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276739840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.958384:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126886.958418:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaae8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.958467:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.958483:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.958495:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166b400, rc 0) 00000100:00100000:1.0:1789126886.958610:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276739840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 720us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.958627:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789126886.959008:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104069e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276739840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126886.959035:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.959046:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126886.959168:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104069e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276739968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.959574:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.959797:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.961364:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276739968 00000100:00100000:1.0:1789126886.961527:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276739968 00000100:00100000:1.0:1789126886.961910:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789126886.961926:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276739968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.962232:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276739968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.962266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789126886.962418:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104069e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276739968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.962497:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.962558:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.964097:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740096 00000100:00100000:0.0:1789126886.964113:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740096 00000100:00100000:3.0:1789126886.964571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789126886.964587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276740096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.964818:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276740096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.964825:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789126886.965404:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789126886.965431:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.966563:0:13729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13729:1876035276740224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126886.966639:0:13729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.966715:0:13729:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.968199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740224 00000100:00100000:1.0:1789126886.968214:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740224 00000100:00100000:1.0:1789126886.968405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789126886.968419:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:13729:x1876035276740224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.968778:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:13729:x1876035276740224:12345-0@lo:502:llog_process_th.0 Request processed in 361us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.968788:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789126886.969608:0:13729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13729:1876035276740224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126886.969687:0:13729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126886.969712:0:13729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126886.969717:0:13729:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789126886.969726:0:13729:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994102d1e800 00000020:00000080:0.0:1789126886.969729:0:13729:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789126886.969859:0:13729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13729:1876035276740352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126886.969933:0:13729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.969987:0:13729:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126886.970182:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740352 00000100:00100000:3.0:1789126886.970191:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740352 00000100:00100000:3.0:1789126886.970247:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789126886.970260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:13729:x1876035276740352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126886.970432:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:13729:x1876035276740352:12345-0@lo:502:llog_process_th.0 Request processed in 174us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.970441:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789126886.970821:0:13729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13729:1876035276740352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126886.970850:0:13729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126886.970858:0:13729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126886.970860:0:13729:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789126886.970865:0:13729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789126886.971543:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789126886.971575:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126886.971589:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.971604:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126886.971630:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789126886.971632:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 7 10000000:01000000:0.0:1789126886.971636:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789126886.972462:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.972477:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126886.972490:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126886.972521:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.972612:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.972692:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126886.974686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740480 00000100:00100000:2.0:1789126886.974703:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740480 00000100:00100000:2.0:1789126886.974797:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789126886.974810:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276740480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126886.974833:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126886.974858:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaaf6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.974896:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.974909:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.974928:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126886.977995:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276740480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3167us (5361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.978015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789126886.978072:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.978115:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.978132:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126886.978268:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.978345:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.978401:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789126886.978456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740608 00000100:00100000:3.0:1789126886.978467:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740608 00000100:00100000:3.0:1789126886.978519:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789126886.978531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276740608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.978729:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276740608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.978737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789126886.978752:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.978790:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.978840:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126886.978925:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126886.978939:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740736 00000100:00100000:3.0:1789126886.978944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740736 00000100:00100000:3.0:1789126886.978974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789126886.978982:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276740736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.979076:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276740736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.979101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789126886.979105:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276740736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.979604:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13732:1876035276740864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126886.979681:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126886.979707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740864 00000100:00100000:3.0:1789126886.979712:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740864 00000100:00100000:2.0:1789126886.979713:0:13732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789126886.979742:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789126886.979750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:13732:x1876035276740864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126886.979834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:13732:x1876035276740864:12345-0@lo:502:llog_process_th.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.979841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789126886.980110:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13732:1876035276740864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126886.980143:0:13732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789126886.980165:0:13732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126886.980169:0:13732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789126886.980472:0:13732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994220b43000 00000020:00000080:2.0:1789126886.980476:0:13732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789126886.980586:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13732:1876035276740992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126886.980634:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126886.980994:0:13732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.981306:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276740992 00000100:00100000:1.0:1789126886.981321:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276740992 00000100:00100000:1.0:1789126886.981489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789126886.981500:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:13732:x1876035276740992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.981629:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:13732:x1876035276740992:12345-0@lo:502:llog_process_th.0 Request processed in 130us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.981638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789126886.981883:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13732:1876035276740992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126886.981916:0:13732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126886.981924:0:13732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126886.981926:0:13732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789126886.981931:0:13732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789126886.982039:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789126886.982291:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126886.982305:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.982329:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126886.982343:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126886.982346:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 7 10000000:01000000:2.0:1789126886.982349:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126886.982466:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.982477:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126886.982487:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126886.982516:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126886.982563:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126886.982603:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.983145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741120 00000100:00100000:1.0:1789126886.983152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741120 00000100:00100000:1.0:1789126886.983324:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789126886.983335:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276741120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.983350:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126886.983492:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab04 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.983527:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.983539:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.983549:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166ac00, rc 0) 00000100:00100000:1.0:1789126886.983614:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.983621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789126886.983819:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.983838:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.983848:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126886.983932:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.983968:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.983992:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.984140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741248 00000100:00100000:1.0:1789126886.984145:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741248 00000100:00100000:1.0:1789126886.984163:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789126886.984169:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.984550:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.984560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789126886.984640:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.984884:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.984941:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126886.985027:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.985281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741376 00000100:00100000:1.0:1789126886.985287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741376 00000100:00100000:1.0:1789126886.985367:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789126886.985389:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.985489:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.985496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789126886.985543:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.986074:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13733:1876035276741504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.986119:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.986141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741504 00000100:00100000:1.0:1789126886.986145:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741504 00000100:00100000:1.0:1789126886.986167:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789126886.986288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:13733:x1876035276741504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.986487:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:13733:x1876035276741504:12345-0@lo:502:llog_process_th.0 Request processed in 314us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.986495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789126886.986527:0:13733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.986542:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13733:1876035276741504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126886.986576:0:13733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126886.986589:0:13733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126886.986593:0:13733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789126886.986601:0:13733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423d256000 00000020:00000080:1.0:1789126886.986604:0:13733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126886.986892:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13733:1876035276741632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.986932:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.986954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741632 00000100:00100000:1.0:1789126886.986958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741632 00000100:00100000:1.0:1789126886.986978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789126886.986985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:13733:x1876035276741632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126886.987578:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:13733:x1876035276741632:12345-0@lo:502:llog_process_th.0 Request processed in 590us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.987587:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789126886.987630:0:13733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.987789:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13733:1876035276741632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126886.987815:0:13733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126886.987821:0:13733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126886.987823:0:13733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789126886.987827:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789126886.987907:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789126886.987929:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126886.987940:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.987953:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126886.987977:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126886.987980:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 7 10000000:01000000:1.0:1789126886.987984:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126886.988128:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.988138:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.988147:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126886.988166:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.988839:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.988864:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.988884:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741760 00000100:00100000:1.0:1789126886.988889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741760 00000100:00100000:1.0:1789126886.988924:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789126886.988932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276741760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.988946:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126886.988961:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab12 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.988992:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab12 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.989456:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab12 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.989481:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166be00, rc 0) 00000100:00100000:1.0:1789126886.989532:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276741760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 599us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.989539:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789126886.989594:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126886.989614:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126886.989624:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126886.990350:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.990479:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126886.990509:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789126886.990538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276741888 00000100:00100000:1.0:1789126886.990546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276741888 00000100:00100000:1.0:1789126886.990584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789126886.990593:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276741888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126886.991799:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276741888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 782us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126886.991811:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789126886.992464:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276741888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.992535:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276742016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.992609:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.992662:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126886.993022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742016 00000100:00100000:3.0:1789126886.993030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742016 00000100:00100000:3.0:1789126886.993934:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789126886.993950:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276742016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126886.994200:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276742016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126886.994210:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789126886.994451:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276742016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126886.997448:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13734:1876035276742144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126886.997554:0:13734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.997617:0:13734:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09480 going to sleep for 11 seconds 00000100:00100000:2.0:1789126886.997701:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742144 00000100:00100000:2.0:1789126886.997710:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742144 00000100:00100000:2.0:1789126886.997780:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789126886.997791:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:13734:x1876035276742144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126886.997979:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:13734:x1876035276742144:12345-0@lo:502:llog_process_th.0 Request processed in 189us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126886.997989:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789126886.999224:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13734:1876035276742144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126886.999274:0:13734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126886.999293:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126886.999296:0:13734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789126886.999305:0:13734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994212236800 00000020:00000080:0.0:1789126886.999308:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789126886.999617:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13734:1876035276742272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126886.999719:0:13734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126886.999761:0:13734:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09480 going to sleep for 11 seconds 00000100:00100000:2.0:1789126887.000077:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742272 00000100:00100000:2.0:1789126887.000086:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742272 00000100:00100000:1.0:1789126887.000159:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789126887.000488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:13734:x1876035276742272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126887.000753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:13734:x1876035276742272:12345-0@lo:502:llog_process_th.0 Request processed in 582us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126887.000762:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789126887.000914:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:13734:1876035276742272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126887.000948:0:13734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126887.000956:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126887.000959:0:13734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789126887.000963:0:13734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789126887.001446:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789126887.001488:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126887.001503:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126887.001516:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126887.850789:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126888.108116:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276742400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126888.108222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126888.108300:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276742528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126888.108343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126888.108383:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742400 00000100:00100000:1.0:1789126888.108391:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742400 00000100:00100000:1.0:1789126888.108455:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742528 00000100:00100000:1.0:1789126888.108459:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742528 00000100:00100000:1.0:1789126888.108479:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789126888.108488:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276742400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126888.108529:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126888.108577:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276742400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126888.108586:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789126888.108590:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276742784:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.108610:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789126888.108618:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276742528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126888.108628:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126888.108636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126888.108677:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276742528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.108685:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276743296:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.108686:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789126888.108713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.108730:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276743808:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.108749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.108772:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789126888.108784:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276742912:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.108812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.108825:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276743424:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.108844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.108858:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276743936:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.108874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789126888.108891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126888.108902:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742784 00000100:00100000:2.0:1789126888.108905:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742784 00000100:00100000:2.0:1789126888.108929:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743296 00000100:00100000:2.0:1789126888.108931:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743296 00000100:00100000:2.0:1789126888.108949:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743808 00000100:00100000:2.0:1789126888.108951:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743808 00000100:00100000:2.0:1789126888.108962:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743424 00000100:00100000:2.0:1789126888.108963:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743424 00000100:00100000:2.0:1789126888.108974:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743936 00000100:00100000:2.0:1789126888.108976:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743936 00000100:00100000:2.0:1789126888.108987:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789126888.109003:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276742784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.109044:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276742784:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.109051:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789126888.109065:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789126888.109075:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276743296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.109100:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276743296:12345-0@lo:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.109106:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789126888.109116:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789126888.109127:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276743808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.109151:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276743808:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.109156:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789126888.109166:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789126888.109170:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276743424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.109188:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276743424:12345-0@lo:400:kworker.0 Request processed in 19us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.109193:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789126888.109201:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789126888.109205:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276743936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.109222:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276743936:12345-0@lo:400:kworker.0 Request processed in 17us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.109228:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789126888.109254:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276742656:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.109954:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742912 00000100:00100000:1.0:1789126888.109963:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742912 00000100:00100000:2.0:1789126888.109967:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.110005:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276743168:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.110010:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789126888.110021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276742912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.110031:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.110054:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276743680:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.110079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276742912:12345-0@lo:400:kworker.0 Request processed in 60us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.110084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126888.110092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789126888.110109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743168 00000100:00100000:2.0:1789126888.110111:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789126888.110113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743168 00000100:00100000:2.0:1789126888.110129:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276743040:0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.110133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789126888.110161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.110193:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276743552:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.110231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126888.110278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276742656 00000100:00100000:2.0:1789126888.110282:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276742656 00000100:00100000:2.0:1789126888.110334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789126888.110345:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276742656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.110392:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276742656:12345-0@lo:400:kworker.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.110399:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789126888.110445:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743680 00000100:00100000:2.0:1789126888.110450:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743680 00000100:00100000:2.0:1789126888.110480:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743552 00000100:00100000:2.0:1789126888.110483:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743552 00000100:00100000:2.0:1789126888.110507:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789126888.110516:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276743680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.110535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276743168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.110553:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276743680:12345-0@lo:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.110561:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789126888.110578:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789126888.110583:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276743168:12345-0@lo:400:kworker.0 Request processed in 432us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.110590:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276743552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126888.110594:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789126888.110632:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276743552:12345-0@lo:400:kworker.0 Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.110637:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789126888.110678:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789126888.110683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126888.110685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789126888.110742:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec21c0 x1876035276742528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126888.110774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276742528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126888.110780:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276743040 00000100:00100000:2.0:1789126888.110798:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276743040 00010000:00080000:3.0:1789126888.110825:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec0000 x1876035276742400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126888.110877:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789126888.110903:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276743040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111246:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276742400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126888.111286:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276742912:0@lo:400:kworker.0 00010000:00080000:3.0:1789126888.111302:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043d9680 x1876035276743424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126888.111324:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276743424:0@lo:400:kworker.0 00010000:00080000:3.0:1789126888.111337:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043db480 x1876035276743936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126888.111347:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276743936:0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111360:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276742784:0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111374:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276743296:0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111387:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276743808:0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111797:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276743040:0@lo:400:kworker.0 00010000:00080000:3.0:1789126888.111810:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043db0c0 x1876035276743552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126888.111820:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276743552:0@lo:400:kworker.0 00000100:00100000:3.0:1789126888.111831:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276742656:0@lo:400:kworker.0 00000100:00100000:2.0:1789126888.111945:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276743040:12345-0@lo:400:kworker.0 Request processed in 120us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126888.111957:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789126888.112218:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276743168:0@lo:400:kworker.0 00010000:00080000:3.0:1789126888.112239:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043d92c0 x1876035276743680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126888.112263:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276743680:0@lo:400:kworker.0 00010000:00010000:3.0:1789126888.875942:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126889.898871:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126890.158626:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276744064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126890.158736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126890.159128:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744064 00000100:00100000:0.0:1789126890.159140:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744064 00000100:00100000:0.0:1789126890.159211:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789126890.159222:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276744064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126890.159270:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126890.159351:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276744064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126890.159360:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789126890.163528:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276744064:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789126890.636966:0:13966:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc7eb75f0 20000000:00000080:0.0:1789126890.636989:0:13966:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99423662bc00 uarg=0000000000000000 20000000:01000000:0.0:1789126890.637043:0:13966:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789126890.637051:0:13966:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789126890.637057:0:13966:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:1.0:1789126890.638303:0:13967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789126890.638576:0:13966:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789126890.656629:0:13966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:2.0:1789126890.656696:0:13966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:2.0:1789126890.658807:0:13966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:2.0:1789126890.658861:0:13966:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789126890.658891:0:13966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658916:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658925:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658935:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658954:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658962:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658968:0:13966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab12 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.658976:0:13966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659045:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659063:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659080:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744192:0@lo:104: 00000100:00100000:2.0:1789126890.659182:0:13966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126890.659302:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659312:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659321:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744320:0@lo:104: 00000100:00100000:3.0:1789126890.659353:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744192 00000100:00100000:2.0:1789126890.659353:0:13966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126890.659365:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744192 00010000:00010000:2.0:1789126890.659403:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659412:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659421:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744448:0@lo:104: 00000100:00100000:2.0:1789126890.659443:0:13966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126890.659447:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744320 00000100:00100000:0.0:1789126890.659451:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744320 00010000:00010000:2.0:1789126890.659459:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659466:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659485:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104819a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744576:0@lo:104: 00000100:00100000:0.0:1789126890.659486:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744448 00000100:00100000:0.0:1789126890.659488:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744448 00000100:00100000:0.0:1789126890.659503:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789126890.659508:0:13966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126890.659513:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104819680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13966:x1876035276744320:12345-0@lo:104: 00010000:00010000:2.0:1789126890.659526:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.659528:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659537:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659546:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744704:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126890.659602:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789126890.659617:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789126890.659624:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789126890.659625:0:13966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.659634:0:13966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 12 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.659643:0:13966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744832:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126890.662814:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126890.662837:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104819680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13966:x1876035276744320:12345-0@lo:104: Request processed in 3318us (3479us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126890.662844:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789126890.662855:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1789126890.662866:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.662880:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126890.662884:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.662896:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126890.662904:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126890.662910:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126890.662960:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.662967:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126890.663132:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663140:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666eab04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663174:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126890.663176:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126890.663178:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126890.663239:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744576 00000100:00100000:0.0:1789126890.663260:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744576 00000100:00100000:0.0:1789126890.663310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126890.663320:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13966:x1876035276744448:12345-0@lo:104: 00010000:00010000:0.0:1789126890.663336:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.663418:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789126890.663424:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+5:13966:x1876035276744448:12345-0@lo:104: Request processed in 106us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126890.663447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789126890.663461:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789126890.663471:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13966:x1876035276744192:12345-0@lo:104: 00010000:00010000:1.0:1789126890.663472:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126890.663483:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.663487:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663505:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126890.663512:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663523:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126890.663531:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126890.663538:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126890.663556:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789126890.663561:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.663570:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:13966:x1876035276744192:12345-0@lo:104: Request processed in 96us (4383us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126890.663583:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789126890.663589:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1789126890.663610:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.663619:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789126890.663633:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666eaaf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaafd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.663637:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941032be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13966:x1876035276744576:12345-0@lo:104: 00010000:00010000:0.0:1789126890.663692:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663695:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126890.663707:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663714:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126890.663718:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663728:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126890.663736:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.663741:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1789126890.663742:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789126890.663755:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941032be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:13966:x1876035276744576:12345-0@lo:104: Request processed in 121us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126890.663764:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789126890.663768:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663776:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126890.663785:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663792:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166a000/0xa840b4da666eab12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663806:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126890.663809:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663815:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126890.663819:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663834:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126890.663841:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126890.663846:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126890.663857:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663923:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126890.663930:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663936:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca000/0xa840b4da666eaae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eaaef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.663949:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126890.663950:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126890.663952:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126890.663962:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126890.665587:0:13966:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126890.665637:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744192:0@lo:104: 00000100:00100000:2.0:1789126890.665681:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744320:0@lo:104: 00000100:00100000:2.0:1789126890.665693:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744448:0@lo:104: 00000100:00100000:2.0:1789126890.665704:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104819a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744576:0@lo:104: 00010000:00010000:2.0:1789126890.665758:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126890.665781:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276745344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126890.666301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126890.666417:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126890.666448:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276744960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126890.666481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126890.666766:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276745216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126890.666850:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276745088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789126890.670730:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276745472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126890.670808:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126890.671411:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745472 00000100:00100000:0.0:1789126890.671426:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745344 00000100:00100000:0.0:1789126890.671436:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745344 00000100:00100000:1.0:1789126890.671473:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745472 00010000:00010000:0.0:1789126890.671497:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 24 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.671545:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276744960 00000100:00100000:0.0:1789126890.671550:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276744960 00010000:00010000:0.0:1789126890.671571:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 25 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126890.671583:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789126890.671616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126890.671617:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276745472:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126890.671639:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258832896 00000100:00100000:0.0:1789126890.671645:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258832896 00010000:00010000:0.0:1789126890.671685:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.671707:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00002000:00000024:1.0:1789126890.671708:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126890.671717:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+25:3641:x1876035276745344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126890.671735:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126890.671744:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 25 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.671758:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 25 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.671783:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166b400/0xa840b4da666eaaef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaae8 expref: 25 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.671806:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126890.671823:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276745472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126890.671834:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789126890.671928:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276745344:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126890.671937:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789126890.672352:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789126890.672361:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+23:3641:x1876035276744960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126890.672369:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126890.672374:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.672383:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.672405:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166ac00/0xa840b4da666eab0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab04 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.672417:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126890.672445:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+22:3641:x1876035276744960:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (5962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126890.672472:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00080000:1.0:1789126890.672480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126890.672488:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258832896:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789126890.672500:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1789126890.672500:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126890.672506:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.672518:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 13 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126890.672520:0:7920:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1789126890.672541:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126890.672541:0:7920:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1789126890.672594:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258832896:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 111us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126890.672603:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00010000:00080000:1.0:1789126890.672610:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104305e00 x1876035276745472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126890.672626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833024 00000100:00100000:2.0:1789126890.672632:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833024 00000100:00100000:1.0:1789126890.672640:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276745472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789126890.672667:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 13 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126890.672687:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1789126890.672698:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258833024:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126890.672707:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126890.672712:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 13 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126890.672721:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 13 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126890.672742:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276744960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126890.672742:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126890.672761:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276745344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126890.672770:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258833024:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126890.672777:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00010000:00010000:3.0:1789126890.672817:0:13966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb200/0xa840b4da666eaae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c31c expref: 12 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126890.672835:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744704:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126890.672847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126890.672857:0:13966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2c00/0xa840b4da666eaada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c315 expref: 11 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126890.672914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276745600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126890.672966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126890.673012:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745600 00000100:00100000:1.0:1789126890.673017:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745600 00000100:00100000:1.0:1789126890.673061:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789126890.673070:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276745600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126890.673088:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126890.673126:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276745600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126890.673133:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789126890.673149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126890.673159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126890.673199:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789126890.673214:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104307c00 x1876035276745600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126890.673223:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745088 00000100:00100000:1.0:1789126890.673232:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104307c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276745600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126890.673283:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745216 00000100:00100000:0.0:1789126890.673294:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745088 00000100:00100000:1.0:1789126890.673303:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745216 00010000:00010000:0.0:1789126890.673317:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.673342:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1789126890.673351:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.673354:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276745088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126890.673369:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126890.673376:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126890.673388:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126890.673398:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1789126890.673410:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2600/0xa840b4da666eaafd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eaaf6 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126890.673420:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+23:3640:x1876035276745216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126890.673434:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126890.673442:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126890.673452:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 22 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673470:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 22 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.673487:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276745088:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (656us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126890.673493:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166be00/0xa840b4da666eab19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab12 expref: 22 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.673504:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1789126890.673526:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673539:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126890.673557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104306940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276745088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789126890.673559:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673574:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673581:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673588:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673606:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126890.673612:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673620:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673629:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.673640:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126890.673775:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+20:3640:x1876035276745216:12345-0@lo:103:ldlm_bl.0 Request processed in 365us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126890.673782:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789126890.673853:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276745216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789126890.674625:0:13966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13966:1876035276744832:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126890.674782:0:13966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126890.674793:0:13966:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126890.674800:0:13966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126890.674807:0:13966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eab20 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126890.923181:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126891.691490:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126891.691525:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276745728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126891.691626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126891.691806:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745728 00000100:00100000:1.0:1789126891.691817:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745728 00000100:00100000:1.0:1789126891.691942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789126891.691956:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276745728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126891.692010:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126891.692080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276745728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126891.692090:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789126891.692225:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276745728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126891.858529:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126891.858810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126891.858835:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126891.858906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126891.858937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126891.859081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833408 00000100:00100000:2.0:1789126891.859111:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833408 00000100:00100000:2.0:1789126891.859224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833664 00000100:00100000:2.0:1789126891.859228:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833664 00000100:00100000:2.0:1789126891.859245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833280 00000100:00100000:2.0:1789126891.859249:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833280 00000100:00100000:2.0:1789126891.859266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833536 00000100:00100000:2.0:1789126891.859268:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833536 00000100:00100000:2.0:1789126891.859297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:2.0:1789126891.859309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258833408:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126891.859913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258833408:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 600us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126891.859924:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:2.0:1789126891.859957:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:2.0:1789126891.859968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258833664:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126891.860004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258833664:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 40us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126891.860010:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:2.0:1789126891.860023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:2.0:1789126891.860030:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258833280:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126891.860056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258833280:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126891.860075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:2.0:1789126891.860088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:2.0:1789126891.860095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258833536:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126891.860220:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258833536:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126891.860228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00080000:1.0:1789126891.860439:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126891.860445:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126891.863384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833152 00000100:00100000:0.0:1789126891.863404:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833152 00000100:00100000:0.0:1789126891.863506:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 364 00000100:00100000:0.0:1789126891.863524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258833152:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126891.863642:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258833152:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 121us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126891.863677:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 364 00010000:00010000:1.0:1789126891.947332:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789126892.651559:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126892.651571:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 10 10000000:01000000:2.0:1789126892.651579:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126892.651642:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.651674:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.651688:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126892.651725:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276745856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.651816:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.651911:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789126892.652006:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745856 00000100:00100000:0.0:1789126892.652016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745856 00000100:00100000:0.0:1789126892.652071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789126892.652083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276745856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126892.652096:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126892.652111:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab27 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.652136:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab27 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.652147:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab27 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.652156:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cbc00, rc 0) 00000100:00100000:0.0:1789126892.652211:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276745856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126892.652218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789126892.652318:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276745856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126892.652335:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.652343:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126892.652432:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276745984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.652458:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.652490:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789126892.652539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276745984 00000100:00100000:0.0:1789126892.652543:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276745984 00000100:00100000:0.0:1789126892.652571:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789126892.652577:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276745984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126892.652719:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276745984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126892.652728:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789126892.653974:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276745984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.654035:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.654101:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.654337:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789126892.654600:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746112 00000100:00100000:1.0:1789126892.654608:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746112 00000100:00100000:1.0:1789126892.654682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789126892.654693:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276746112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126892.654843:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276746112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.654853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789126892.654878:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.658573:0:14037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14037:1876035276746240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.658676:0:14037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.658720:0:14037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789126892.658778:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746240 00000100:00100000:1.0:1789126892.658786:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746240 00000100:00100000:1.0:1789126892.658837:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789126892.658847:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:14037:x1876035276746240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126892.658972:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:14037:x1876035276746240:12345-0@lo:502:llog_process_th.0 Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.658980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789126892.659188:0:14037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14037:1876035276746240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.659330:0:14037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126892.659340:0:14037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.659342:0:14037:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789126892.659348:0:14037:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994102d1e800 00000020:00000080:3.0:1789126892.659351:0:14037:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789126892.659431:0:14037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14037:1876035276746368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.659462:0:14037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.659518:0:14037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789126892.659579:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746368 00000100:00100000:1.0:1789126892.659583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746368 00000100:00100000:1.0:1789126892.659641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789126892.659669:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14037:x1876035276746368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126892.659750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14037:x1876035276746368:12345-0@lo:502:llog_process_th.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.659757:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789126892.659931:0:14037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14037:1876035276746368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.659951:0:14037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126892.659956:0:14037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.659958:0:14037:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789126892.659967:0:14037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789126892.660144:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789126892.660179:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789126892.660189:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.660199:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126892.660209:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789126892.660212:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 10 10000000:01000000:1.0:1789126892.660214:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789126892.661617:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.661631:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.661641:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126892.661678:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789126892.661743:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126892.661786:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126892.662069:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746496 00000100:00100000:0.0:1789126892.662076:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746496 00000100:00100000:0.0:1789126892.662132:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789126892.662142:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276746496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126892.662156:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126892.662170:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab35 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.662198:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab35 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.662211:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab35 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126892.662220:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb200, rc 0) 00000100:00100000:0.0:1789126892.662261:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276746496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126892.662289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789126892.665184:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126892.665210:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.665224:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126892.665312:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.665364:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.665435:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.669315:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746624 00000100:00100000:2.0:1789126892.669330:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746624 00000100:00100000:2.0:1789126892.669396:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789126892.669406:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276746624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.669576:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276746624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.669584:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789126892.669882:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.669947:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.670009:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.670048:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.671248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746752 00000100:00100000:2.0:1789126892.671257:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746752 00000100:00100000:2.0:1789126892.671329:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789126892.671340:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276746752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.671498:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276746752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.671506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789126892.671616:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276746752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.671864:0:14039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14039:1876035276746880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.671925:0:14039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.671952:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276746880 00000100:00100000:3.0:1789126892.671956:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276746880 00000100:00100000:3.0:1789126892.671980:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789126892.671987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:14039:x1876035276746880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.672078:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:14039:x1876035276746880:12345-0@lo:502:llog_process_th.0 Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.672085:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789126892.672130:0:14039:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789126892.672143:0:14039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14039:1876035276746880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.672162:0:14039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126892.672172:0:14039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.672174:0:14039:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789126892.672180:0:14039:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994220b43000 00000020:00000080:3.0:1789126892.672183:0:14039:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789126892.672481:0:14039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14039:1876035276747008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.672521:0:14039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.672543:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747008 00000100:00100000:3.0:1789126892.672546:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747008 00000100:00100000:3.0:1789126892.672568:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789126892.672575:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:14039:x1876035276747008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.672641:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:14039:x1876035276747008:12345-0@lo:502:llog_process_th.0 Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.672683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789126892.672717:0:14039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126892.672729:0:14039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14039:1876035276747008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.672746:0:14039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126892.672751:0:14039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.672752:0:14039:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789126892.672756:0:14039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789126892.672810:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789126892.672828:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126892.672838:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.672849:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126892.672866:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789126892.672868:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 10 10000000:01000000:3.0:1789126892.673715:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789126892.673744:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.673753:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.673761:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126892.673777:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.673813:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.673837:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.674197:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747136 00000100:00100000:2.0:1789126892.674204:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747136 00000100:00100000:2.0:1789126892.674245:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789126892.674265:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276747136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126892.674286:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126892.674301:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab43 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.674323:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab43 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.674334:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab43 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.674343:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:2.0:1789126892.674385:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.674392:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789126892.674431:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126892.674444:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.674454:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126892.674511:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.674535:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.674549:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.674561:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747264 00000100:00100000:2.0:1789126892.674564:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747264 00000100:00100000:2.0:1789126892.674584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789126892.674596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.675594:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 994us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.675604:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789126892.679388:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.679459:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.679532:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.679571:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126892.679592:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747392 00000100:00100000:3.0:1789126892.679598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747392 00000100:00100000:3.0:1789126892.679672:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789126892.679681:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.679800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.679808:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789126892.679857:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.680022:0:14041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14041:1876035276747520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.680051:0:14041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.680068:0:14041:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.680226:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747520 00000100:00100000:2.0:1789126892.680230:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747520 00000100:00100000:2.0:1789126892.680263:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789126892.680279:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:14041:x1876035276747520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126892.680359:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:14041:x1876035276747520:12345-0@lo:502:llog_process_th.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.680366:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789126892.680457:0:14041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14041:1876035276747520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.680480:0:14041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789126892.680489:0:14041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.680492:0:14041:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789126892.680499:0:14041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423d256000 00000020:00000080:3.0:1789126892.680502:0:14041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789126892.680576:0:14041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14041:1876035276747648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.680612:0:14041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.680634:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747648 00000100:00100000:3.0:1789126892.680638:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747648 00000100:00100000:3.0:1789126892.680733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789126892.680740:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14041:x1876035276747648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126892.680804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14041:x1876035276747648:12345-0@lo:502:llog_process_th.0 Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.680811:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789126892.680853:0:14041:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126892.680866:0:14041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14041:1876035276747648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789126892.680883:0:14041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789126892.680888:0:14041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789126892.680889:0:14041:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789126892.680893:0:14041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789126892.680949:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789126892.681000:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126892.681008:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.681019:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126892.681028:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789126892.681490:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 10 10000000:01000000:3.0:1789126892.681493:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789126892.681523:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.681532:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.681540:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126892.681555:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.681585:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126892.681622:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942033933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.681754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747776 00000100:00100000:2.0:1789126892.681759:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747776 00000100:00100000:2.0:1789126892.681792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789126892.681800:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276747776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126892.681810:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126892.681823:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eab51 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.681846:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eab51 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.681856:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab51 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.681864:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3200, rc 0) 00000100:00100000:2.0:1789126892.681896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276747776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.681907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789126892.681941:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043db0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126892.681953:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.681963:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126892.682013:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682049:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.682067:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.682077:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276747904 00000100:00100000:2.0:1789126892.682081:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276747904 00000100:00100000:2.0:1789126892.682102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789126892.682107:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276747904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682196:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276747904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.682202:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789126892.682227:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276747904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682250:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276748032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682294:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.682306:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.682315:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748032 00000100:00100000:2.0:1789126892.682317:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748032 00000100:00100000:2.0:1789126892.682334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789126892.682346:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276748032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682411:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276748032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.682417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789126892.682453:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276748032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126892.682608:0:14042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14042:1876035276748160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126892.682638:0:14042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.682680:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748160 00000100:00100000:2.0:1789126892.682683:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748160 00000100:00100000:2.0:1789126892.682703:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789126892.682709:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14042:x1876035276748160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126892.682772:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14042:x1876035276748160:12345-0@lo:502:llog_process_th.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.682778:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789126892.682804:0:14042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.682815:0:14042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14042:1876035276748160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126892.682837:0:14042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789126892.682845:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126892.682848:0:14042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789126892.682854:0:14042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994212236800 00000020:00000080:2.0:1789126892.682856:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789126892.683134:0:14042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14042:1876035276748288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126892.683166:0:14042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126892.683185:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748288 00000100:00100000:2.0:1789126892.683189:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748288 00000100:00100000:2.0:1789126892.683215:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789126892.683220:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14042:x1876035276748288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126892.683289:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14042:x1876035276748288:12345-0@lo:502:llog_process_th.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126892.683296:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789126892.683324:0:14042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789126892.683336:0:14042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14042:1876035276748288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789126892.683352:0:14042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789126892.683356:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789126892.683358:0:14042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789126892.683362:0:14042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789126892.683418:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789126892.683465:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126892.683475:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126892.683485:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126892.686168:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126892.686869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833792 00000100:00100000:3.0:1789126892.686880:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833792 00000100:00100000:3.0:1789126892.686976:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 385 00000100:00100000:3.0:1789126892.686987:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:6161:x1876035258833792:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126892.687008:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126892.687034:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c323 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.687100:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.687111:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126892.687121:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f000, rc 0) 00000100:00100000:3.0:1789126892.687183:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258833792:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.687190:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 385 00000100:00100000:1.0:1789126892.691935:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126892.692022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258833920 00000100:00100000:3.0:1789126892.692045:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258833920 00000100:00100000:3.0:1789126892.692261:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 386 00000100:00100000:3.0:1789126892.692293:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258833920:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.694233:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258833920:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 1942us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.694255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 386 00000100:00100000:3.0:1789126892.696228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126892.696291:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834048 00000100:00100000:3.0:1789126892.696302:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834048 00000100:00100000:3.0:1789126892.696380:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 387 00000100:00100000:3.0:1789126892.696395:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258834048:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.696586:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258834048:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 194us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.696594:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 387 00000100:00100000:1.0:1789126892.706721:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126892.710035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834176 00000100:00100000:3.0:1789126892.710056:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834176 00000100:00100000:3.0:1789126892.710141:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 388 00000100:00100000:3.0:1789126892.710164:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10375:x1876035258834176:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789126892.710599:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10375:x1876035258834176:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 438us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.710609:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 388 00000100:00100000:2.0:1789126892.718099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126892.718173:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834304 00000100:00100000:1.0:1789126892.718192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834304 00000100:00100000:1.0:1789126892.719083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 389 00000100:00100000:1.0:1789126892.719106:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10375:x1876035258834304:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789126892.719370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:10375:x1876035258834304:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 270us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.719774:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 389 00000100:00100000:0.0:1789126892.728791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126892.728935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834432 00000100:00100000:1.0:1789126892.728951:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834432 00000100:00100000:1.0:1789126892.729286:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 390 00000100:00100000:1.0:1789126892.729300:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258834432:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126892.729323:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126892.729348:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c32a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.729385:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.729533:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126892.729546:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166ac00, rc 0) 00000100:00100000:1.0:1789126892.729715:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258834432:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 418us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.729724:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 390 00000100:00100000:0.0:1789126892.740667:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126892.740746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834560 00000100:00100000:2.0:1789126892.740769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834560 00000100:00100000:3.0:1789126892.741265:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 391 00000100:00100000:3.0:1789126892.741288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258834560:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126892.741515:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258834560:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 230us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126892.741524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 391 00000100:00100000:2.0:1789126892.752181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126892.752421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834688 00000100:00100000:1.0:1789126892.752437:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834688 00000100:00100000:1.0:1789126892.753021:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 392 00000100:00100000:1.0:1789126892.753039:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258834688:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126892.753246:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258834688:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 213us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126892.753256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 392 00000100:00100000:2.0:1789126892.759220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126892.759493:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834816 00000100:00100000:0.0:1789126892.759508:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834816 00000100:00100000:0.0:1789126892.759797:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 393 00000100:00100000:0.0:1789126892.759811:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10378:x1876035258834816:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789126892.760050:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10378:x1876035258834816:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 241us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126892.760060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 393 00000100:00100000:2.0:1789126892.765243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126892.769442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258834944 00000100:00100000:0.0:1789126892.769475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258834944 00000100:00100000:0.0:1789126892.769572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 394 00000100:00100000:0.0:1789126892.769585:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10378:x1876035258834944:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789126892.769879:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:10378:x1876035258834944:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 295us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126892.769890:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 394 00010000:00010000:1.0:1789126892.971239:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126893.227429:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276748416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126893.227546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.227835:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276748672:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.227882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.227904:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276749184:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.227926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.227944:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276749696:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.227986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228014:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789126893.228022:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276748800:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228072:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276749312:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228115:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276749824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228174:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748672 00000100:00100000:2.0:1789126893.228185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748672 00000100:00100000:2.0:1789126893.228238:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749184 00000100:00100000:2.0:1789126893.228241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749184 00000100:00100000:2.0:1789126893.228265:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749696 00000100:00100000:2.0:1789126893.228278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749696 00000100:00100000:2.0:1789126893.228293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749312 00000100:00100000:2.0:1789126893.228295:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749312 00000100:00100000:2.0:1789126893.228307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749824 00000100:00100000:2.0:1789126893.228309:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749824 00000100:00100000:2.0:1789126893.228327:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789126893.228336:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104819680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276748672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228402:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104819680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276748672:12345-0@lo:400:kworker.0 Request processed in 66us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789126893.228439:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789126893.228446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276749184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228479:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276749184:12345-0@lo:400:kworker.0 Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789126893.228497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789126893.228503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276749696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228530:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276749696:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789126893.228548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789126893.228554:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276749312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276749312:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789126893.228604:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789126893.228611:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276749824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276749824:12345-0@lo:400:kworker.0 Request processed in 35us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789126893.228711:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748800 00000100:00100000:2.0:1789126893.228715:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748800 00000100:00100000:2.0:1789126893.228746:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789126893.228753:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276748800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228789:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276748800:12345-0@lo:400:kworker.0 Request processed in 36us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.228802:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789126893.228833:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276748928:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228885:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276749440:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228931:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749952:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.228951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.228970:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789126893.228976:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276748544:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.229029:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749056:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.229064:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749568:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126893.229110:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749440 00000100:00100000:2.0:1789126893.229113:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749440 00000100:00100000:2.0:1789126893.229143:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749952 00000100:00100000:2.0:1789126893.229145:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749952 00000100:00100000:2.0:1789126893.229157:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749568 00000100:00100000:2.0:1789126893.229160:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749568 00000100:00100000:2.0:1789126893.229173:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789126893.229179:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276749440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229215:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276749440:12345-0@lo:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.229221:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789126893.229243:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789126893.229248:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229289:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749952:12345-0@lo:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.229296:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789126893.229307:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789126893.229313:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229341:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749568:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.229348:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789126893.229397:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276748800:0@lo:400:kworker.0 00010000:00080000:2.0:1789126893.229416:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410481a1c0 x1876035276749312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.229429:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276749312:0@lo:400:kworker.0 00010000:00080000:2.0:1789126893.229440:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410481b0c0 x1876035276749824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.229447:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276749824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229458:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276748672:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229468:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276749184:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229477:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104819a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276749696:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748928 00000100:00100000:2.0:1789126893.229514:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748928 00000100:00100000:2.0:1789126893.229549:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789126893.229561:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276748928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229590:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276748928:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126893.229595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:2.0:1789126893.229623:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410481b480 x1876035276749568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.229633:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749568:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.229672:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276748928:0@lo:400:kworker.0 00010000:00080000:2.0:1789126893.229686:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104819e00 x1876035276749440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.229695:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276749440:0@lo:400:kworker.0 00010000:00080000:2.0:1789126893.229708:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410481ad00 x1876035276749952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.229716:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749952:0@lo:400:kworker.0 00000100:00100000:0.0:1789126893.229857:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748544 00000100:00100000:0.0:1789126893.229862:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748544 00000100:00100000:0.0:1789126893.229904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789126893.229913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276748544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126893.229957:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276748544:12345-0@lo:400:kworker.0 Request processed in 46us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126893.229963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789126893.230350:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276750080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126893.230397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126893.230462:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276748416 00000100:00100000:1.0:1789126893.230467:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276748416 00000100:00100000:1.0:1789126893.230515:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750080 00000100:00100000:1.0:1789126893.230519:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750080 00000100:00100000:1.0:1789126893.230539:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789126893.230547:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276748416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126893.230579:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126893.230620:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276748416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126893.230627:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789126893.230673:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789126893.230682:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276750080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126893.230693:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126893.230729:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276750080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126893.230735:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789126893.230756:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126893.230763:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126893.230767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126893.230770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126893.230793:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276749056 00000100:00100000:1.0:1789126893.230798:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276749056 00000100:00100000:1.0:1789126893.230828:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789126893.230836:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126893.230881:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276749056:12345-0@lo:400:kworker.0 Request processed in 46us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126893.230896:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1789126893.230944:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402ad00 x1876035276750080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126893.230967:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276750080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126893.233426:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276748544:0@lo:400:kworker.0 00000100:00100000:2.0:1789126893.233456:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276749056:0@lo:400:kworker.0 00010000:00080000:2.0:1789126893.233476:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410481a940 x1876035276748416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126893.233497:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276748416:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789126893.997466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126895.019038:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126895.274940:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276750208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126895.275051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126895.275163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750208 00000100:00100000:0.0:1789126895.275175:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750208 00000100:00100000:0.0:1789126895.275241:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789126895.275261:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276750208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126895.275305:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126895.275371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276750208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126895.275389:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789126895.275460:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276750208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126895.787466:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276750336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126895.787571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126895.787719:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750336 00000100:00100000:1.0:1789126895.787728:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750336 00000100:00100000:1.0:1789126895.787807:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789126895.787820:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276750336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126895.787868:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126895.787935:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276750336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126895.787945:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789126895.787987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126895.788033:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d1680 x1876035276750336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126895.788057:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276750336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126895.790989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276750464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126895.791086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126895.791295:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750464 00000100:00100000:1.0:1789126895.791304:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750464 00000100:00080000:0.0:1789126895.791379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126895.791401:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789126895.791414:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276750464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126895.791455:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126895.791509:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276750464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126895.791525:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789126895.791722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488d2c0 x1876035276750464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126895.791756:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276750464:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1789126895.845489:0:14171:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:41:34 (1789126894) === 00010000:00010000:1.0:1789126896.046906:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126896.811071:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126896.811108:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276750592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126896.811221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126896.812121:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750592 00000100:00100000:1.0:1789126896.812133:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750592 00000100:00100000:1.0:1789126896.812329:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789126896.812344:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276750592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126896.812399:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126896.812506:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276750592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126896.812514:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789126896.812611:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276750592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126896.974841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126896.974885:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126896.975019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835200 00000100:00100000:0.0:1789126896.975034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835200 00000100:00100000:3.0:1789126896.975060:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835456 00000100:00100000:3.0:1789126896.975076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835456 00000100:00100000:0.0:1789126896.975152:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:3.0:1789126896.975171:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:0.0:1789126896.975181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258835200:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126896.975193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258835456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126896.978307:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258835200:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 3128us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126896.978326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00080000:0.0:1789126896.978386:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126896.984081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258835456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 8874us (9173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126896.984108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:2.0:1789126896.984974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126896.986253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126896.986416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126896.986461:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835328 00000100:00100000:2.0:1789126896.986476:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835328 00000100:00100000:0.0:1789126896.986514:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835072 00000100:00100000:0.0:1789126896.986521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835072 00000100:00100000:2.0:1789126896.986544:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835584 00000100:00100000:2.0:1789126896.986548:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835584 00000100:00100000:0.0:1789126896.986580:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 396 00000100:00100000:2.0:1789126896.986584:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1789126896.986596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258835072:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126896.986597:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258835328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126896.986743:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:3.0:1789126896.986754:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258835584:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126896.987039:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258835328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 446us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126896.987047:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1789126896.987167:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258835072:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 574us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126896.987175:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 396 00000100:00080000:0.0:1789126896.987961:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126896.988163:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258835584:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1407us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126896.988173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00010000:00010000:1.0:1789126897.067293:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126897.086181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.086222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.086258:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835712 00000100:00100000:2.0:1789126897.086268:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835712 00000100:00100000:2.0:1789126897.086314:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1789126897.086324:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258835712:12345-192.168.203.23@tcp:41:mkdir.0 00000004:00000024:2.0:1789126897.086355:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789126897.086428:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258835712:12345-192.168.203.23@tcp:41:mkdir.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126897.086436:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126897.087407:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258835840 00000100:00100000:1.0:1789126897.087415:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258835840 00000100:00100000:1.0:1789126897.087455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:1.0:1789126897.087464:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:10742:x1876035258835840:12345-192.168.203.23@tcp:700:mkdir.0 00000100:00100000:1.0:1789126897.087520:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:10742:x1876035258835840:12345-192.168.203.23@tcp:700:mkdir.0 Request processed in 58us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126897.087528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1789126897.089858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.089897:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836096 00000100:00100000:2.0:1789126897.089914:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836096 00000100:00100000:2.0:1789126897.089982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1789126897.089994:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:10742:x1876035258836096:12345-192.168.203.23@tcp:36:mkdir.0 00010000:00010000:2.0:1789126897.090069:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126897.090130:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ea975 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c282 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090151:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261e500) 00010000:00010000:2.0:1789126897.090163:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126897.090273:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090288:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090298:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090325:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090333:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090339:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090916:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090928:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090943:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126897.090961:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009dc60d33 reply state 000000004a48159c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090973:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.090979:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:2.0:1789126897.090982:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126897.090985:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789126897.090989:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789126897.090996:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091003:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091009:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091015:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126897.091019:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091027:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091035:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994103eaaa00) 00010000:00010000:2.0:1789126897.091038:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126897.091049:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091055:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eab6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126897.091071:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009dc60d33 reply state 000000004a48159c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091080:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.091087:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994103eaad00) 00010000:00010000:2.0:1789126897.091089:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126897.091092:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789126897.091171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:10742:x1876035258836096:12345-192.168.203.23@tcp:36:mkdir.0 Request processed in 1177us (1321us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789126897.091179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1789126897.103344:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.103419:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836224 00000100:00100000:0.0:1789126897.103430:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836224 00000100:00100000:0.0:1789126897.103491:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789126897.103502:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:10743:x1876035258836224:12345-192.168.203.23@tcp:101:chmod.0 00010000:00010000:0.0:1789126897.103526:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126897.103552:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eab82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c331 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103621:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103635:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103725:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126897.103775:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789126897.103779:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126897.103815:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103842:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eab82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c331 expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103878:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c331 expref: 8 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.103887:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04000) 00010000:00010000:0.0:1789126897.103891:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126897.103895:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:0.0:1789126897.103966:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:10743:x1876035258836224:12345-192.168.203.23@tcp:101:chmod.0 Request processed in 465us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126897.103974:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789126897.111337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.111458:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836480 00000100:00100000:3.0:1789126897.111470:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836480 00000100:00100000:3.0:1789126897.111538:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1789126897.111549:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:10743:x1876035258836480:12345-192.168.203.23@tcp:36:chmod.0 00010000:00010000:3.0:1789126897.111604:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126897.111632:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eab89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c331 expref: 8 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.111675:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04000) 00010000:00010000:3.0:1789126897.111687:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126897.111713:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.111726:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.111737:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126897.111958:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006cbef456 reply state 0000000049a2b276 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.111977:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.111983:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.112184:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789126897.112189:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789126897.112196:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789126897.112296:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:10743:x1876035258836480:12345-192.168.203.23@tcp:36:chmod.0 Request processed in 747us (966us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789126897.112304:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1789126897.141438:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.141540:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836608 00000100:00100000:0.0:1789126897.141549:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836608 00000100:00100000:0.0:1789126897.141609:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1789126897.141620:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:10744:x1876035258836608:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:0.0:1789126897.141641:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126897.141880:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eab97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c338 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.141944:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.141957:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.141969:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126897.142008:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126897.142012:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126897.142050:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.142077:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eab97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c338 expref: 11 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.142094:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c338 expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.142103:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.142118:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126897.142121:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031c00, rc 0) 00000100:00100000:3.0:1789126897.142219:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:10744:x1876035258836608:12345-192.168.203.23@tcp:101:chown.0 Request processed in 601us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126897.142226:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1789126897.152571:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.152691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836736 00000100:00100000:3.0:1789126897.152701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836736 00000100:00100000:3.0:1789126897.152761:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1789126897.152771:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:10744:x1876035258836736:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:3.0:1789126897.152796:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126897.152817:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eaba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c33f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152887:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152915:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152926:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152933:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.152939:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153035:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153043:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153050:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126897.153091:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126897.153095:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126897.153113:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153126:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153133:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153139:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153146:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.153150:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153157:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153169:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.153177:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.153183:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153190:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eabac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153205:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153211:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153217:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153222:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.153225:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153231:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153239:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994103eaad00) 00010000:00010000:3.0:1789126897.153254:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.153257:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153264:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eabb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153291:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eaba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c33f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153316:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c33f expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.153324:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:3.0:1789126897.153326:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126897.153329:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126897.153387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104818f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10744:x1876035258836736:12345-192.168.203.23@tcp:101:chown.0 Request processed in 617us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126897.153395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1789126897.159790:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.159866:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258836864 00000100:00100000:3.0:1789126897.159875:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258836864 00000100:00100000:3.0:1789126897.159932:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1789126897.159942:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10744:x1876035258836864:12345-192.168.203.23@tcp:900:chown.0 00000100:00100000:3.0:1789126897.160021:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10744:x1876035258836864:12345-192.168.203.23@tcp:900:chown.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126897.160028:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789126897.167795:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.167896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258837120 00000100:00100000:2.0:1789126897.167907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258837120 00000100:00100000:2.0:1789126897.167975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1789126897.167986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10744:x1876035258837120:12345-192.168.203.23@tcp:36:chown.0 00010000:00010000:2.0:1789126897.168042:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126897.168070:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c33f expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.168109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:2.0:1789126897.168114:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126897.168137:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.168150:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.168160:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126897.172754:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789126897.172868:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.172887:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.172897:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.172904:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3800 already unused, calling callback (ffffffffc193f4f0) 00000004:00010000:1.0:1789126897.172931:0:6512:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028d78f0a reply state 000000003fbcb24b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.172952:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.172969:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126897.172977:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126897.172993:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:3.0:1789126897.172994:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff994103eaad00) 00010000:00010000:1.0:1789126897.172999:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789126897.173003:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789126897.173008:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789126897.173013:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173025:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eab74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126897.173038:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789126897.173053:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173062:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173068:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173072:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.173076:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173081:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173089:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:3.0:1789126897.173092:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.173104:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173110:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eab7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173127:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173136:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173142:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173148:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.173151:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173157:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173168:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.173170:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789126897.173174:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.173179:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eab90 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789126897.173182:0:6512:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789126897.173208:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:10744:x1876035258837120:12345-192.168.203.23@tcp:36:chown.0 Request processed in 5216us (5415us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789126897.173221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00010000:00010000:0.0:1789126897.173551:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173561:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173570:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173577:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126897.173582:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173595:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173609:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff994103eaa900) 00010000:00010000:0.0:1789126897.173612:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789126897.173616:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.173623:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126897.189343:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.191339:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258837248 00000100:00100000:3.0:1789126897.191356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258837248 00000100:00100000:3.0:1789126897.191543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789126897.191566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:10745:x1876035258837248:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:3.0:1789126897.192350:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126897.192387:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eabc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c346 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789126897.200132:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7586us 00010000:00010000:3.0:1789126897.217230:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217271:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217286:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217306:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217316:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217326:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217503:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217511:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217519:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126897.217565:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126897.217570:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126897.217643:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217715:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217725:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217735:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217743:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.217750:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217759:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217778:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.217783:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.217790:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217799:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eabcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217819:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217846:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217856:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217864:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.217870:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217883:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217897:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99423648f500) 00010000:00010000:3.0:1789126897.217901:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.217906:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.217914:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eabd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.218018:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eabc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c346 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.218046:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c346 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.218056:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:3.0:1789126897.218060:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789126897.218078:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030c00, rc 0) 00000100:00100000:3.0:1789126897.218196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:10745:x1876035258837248:12345-192.168.203.23@tcp:101:touch.500 Request processed in 26629us (28861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126897.218209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789126897.221756:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.223612:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258837504 00000100:00100000:2.0:1789126897.223627:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258837504 00000100:00100000:2.0:1789126897.223845:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:2.0:1789126897.223862:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:10745:x1876035258837504:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:2.0:1789126897.223886:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126897.223912:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eabe4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c34d expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224154:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224173:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224190:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224266:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224275:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.224282:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789126897.224813:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789126897.225147:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eabf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225161:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225173:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eabf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225215:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225226:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225234:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225252:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126897.225260:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225287:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225305:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:2.0:1789126897.225310:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126897.225316:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225324:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eabeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126897.225342:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001982ec30 reply state 00000000f74c9cd7 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225355:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225364:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff994103eaaa00) 00010000:00010000:2.0:1789126897.225367:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126897.225370:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789126897.225424:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eabe4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c34d expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225448:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eabf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c34d expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.225458:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaac00) 00010000:00010000:2.0:1789126897.225461:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126897.225464:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2a00, rc 0) 00000100:00100000:2.0:1789126897.225558:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:10745:x1876035258837504:12345-192.168.203.23@tcp:101:touch.500 Request processed in 1700us (3922us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789126897.225581:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1789126897.230000:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.230111:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258837760 00000100:00100000:2.0:1789126897.230129:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258837760 00000100:00100000:2.0:1789126897.230214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1789126897.230231:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:10745:x1876035258837760:12345-192.168.203.23@tcp:36:touch.500 00010000:00010000:2.0:1789126897.230343:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126897.230377:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eabf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c34d expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.230400:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaac00) 00010000:00010000:2.0:1789126897.230414:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126897.230471:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.230487:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.230496:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126897.230614:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002100fe0b reply state 0000000062bc43f1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.230630:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.230639:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:2.0:1789126897.230642:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126897.230702:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789126897.230843:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10745:x1876035258837760:12345-192.168.203.23@tcp:36:touch.500 Request processed in 615us (853us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789126897.230853:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1789126897.233139:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.233272:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258837888 00000100:00100000:2.0:1789126897.233496:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258837888 00000100:00100000:2.0:1789126897.233613:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1789126897.233626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:10745:x1876035258837888:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:2.0:1789126897.233703:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126897.233731:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eac0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c354 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.233801:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eac0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c354 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.233816:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eac0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c354 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.233837:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:2.0:1789126897.233840:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789126897.233845:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:2.0:1789126897.233914:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:10745:x1876035258837888:12345-192.168.203.23@tcp:101:touch.500 Request processed in 291us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126897.233921:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1789126897.239088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.239178:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838016 00000100:00100000:2.0:1789126897.239191:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838016 00000100:00100000:2.0:1789126897.239262:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789126897.239272:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258838016:12345-192.168.203.23@tcp:8:touch.500 00010000:00080000:2.0:1789126897.239462:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:2.0:1789126897.239519:0:8428:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666eac15 00002000:00100000:2.0:1789126897.239535:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7cbe914d-2346-44a4-9fd5-22d31c7628a2/ffff99410434d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789126897.239558:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789126897.239742:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789126897.239781:0:8428:0:(import.c:65:import_set_state_nolock()) ffff994104348000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126897.239901:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258838016:12345-192.168.203.23@tcp:8:touch.500 Request processed in 628us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126897.239911:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789126897.246327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126897.246495:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838144 00000100:00100000:1.0:1789126897.246510:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838144 00000100:00080000:0.0:1789126897.246615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789126897.246616:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1789126897.246632:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:0:x1876035258838144:12345-192.168.203.23@tcp:2:touch.500 00000001:00080000:2.0:1789126897.251000:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1789126897.251022:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000100:00100000:1.0:1789126897.251539:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:0:x1876035258838144:12345-192.168.203.23@tcp:2:touch.500 Request processed in 4902us (5219us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789126897.251555:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1789126897.255231:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.255334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838400 00000100:00100000:0.0:1789126897.255347:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838400 00000100:00100000:0.0:1789126897.255551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1789126897.255563:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:10745:x1876035258838400:12345-192.168.203.23@tcp:35:touch.500 00000100:00100000:0.0:1789126897.256117:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:10745:x1876035258838400:12345-192.168.203.23@tcp:35:touch.500 Request processed in 553us (903us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789126897.256127:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1789126897.271534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.271796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838528 00000100:00100000:0.0:1789126897.271809:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838528 00000100:00100000:0.0:1789126897.271904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1789126897.271918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:10746:x1876035258838528:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:0.0:1789126897.271959:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126897.271990:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eac1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c35b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272104:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272239:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272265:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126897.272333:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789126897.272338:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126897.272387:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272421:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eac1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c35b expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272446:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c35b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.272455:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:0.0:1789126897.272459:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126897.272464:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:0.0:1789126897.272549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:10746:x1876035258838528:12345-192.168.203.23@tcp:101:rm.0 Request processed in 634us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126897.272558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1789126897.276480:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.276771:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838784 00000100:00100000:2.0:1789126897.276784:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838784 00000100:00100000:2.0:1789126897.276858:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1789126897.276872:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:10746:x1876035258838784:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:2.0:1789126897.276903:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126897.276933:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eac2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c362 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126897.277074:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789126897.278139:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eac2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c362 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.278162:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:2.0:1789126897.278166:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126897.278173:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666eac2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c362 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126897.278202:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2a00, rc 0) 00000100:00100000:2.0:1789126897.278955:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:10746:x1876035258838784:12345-192.168.203.23@tcp:101:rm.0 Request processed in 2080us (2486us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789126897.278968:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1789126897.287948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.288086:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258838912 00000100:00100000:0.0:1789126897.288171:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258838912 00000100:00100000:0.0:1789126897.288323:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1789126897.288336:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:10746:x1876035258838912:12345-192.168.203.23@tcp:37:rm.0 00000100:00100000:0.0:1789126897.294750:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:10746:x1876035258838912:12345-192.168.203.23@tcp:37:rm.0 Request processed in 6398us (6797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126897.294769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1789126897.302845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.302998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258839168 00000100:00100000:0.0:1789126897.303012:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258839168 00000100:00100000:0.0:1789126897.303099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1789126897.303113:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212267050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:10746:x1876035258839168:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:0.0:1789126897.303610:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212267050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:10746:x1876035258839168:12345-192.168.203.23@tcp:35:rm.0 Request processed in 497us (779us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789126897.303620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1789126897.306962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.307085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258839424 00000100:00100000:3.0:1789126897.307158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258839424 00000100:00100000:3.0:1789126897.307283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1789126897.307296:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:10746:x1876035258839424:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:3.0:1789126897.307329:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126897.307360:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c369 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.307505:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eac3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.307524:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eac3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.307539:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eac3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126897.307552:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789126897.307730:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c369 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.307778:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eac3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c369 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.307788:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:3.0:1789126897.307792:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126897.307797:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:3.0:1789126897.307882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258839424:12345-192.168.203.23@tcp:101:rm.0 Request processed in 589us (935us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789126897.307892:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1789126897.310716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126897.310971:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258839552 00000100:00100000:2.0:1789126897.310984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258839552 00000100:00100000:2.0:1789126897.311360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1789126897.311374:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258839552:12345-192.168.203.23@tcp:41:rm.0 00000004:00000024:2.0:1789126897.311461:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789126897.311569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258839552:12345-192.168.203.23@tcp:41:rm.0 Request processed in 198us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126897.311578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1789126897.313687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.313793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258839680 00000100:00100000:0.0:1789126897.313803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258839680 00000100:00100000:0.0:1789126897.313867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1789126897.313879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258839680:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:0.0:1789126897.313906:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126897.313933:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eac4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314021:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314040:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314055:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314104:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314114:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314120:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314248:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314258:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314266:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126897.314312:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789126897.314317:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126897.314339:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314359:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314378:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314386:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314403:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314410:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126897.314416:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314424:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314439:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:0.0:1789126897.314443:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126897.314449:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314455:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666eac54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314470:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314477:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314482:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314487:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbe00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126897.314490:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314507:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314516:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff994103eaaa00) 00010000:00010000:0.0:1789126897.314518:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126897.314522:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314529:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666eac5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314561:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eac4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c370 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314577:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c370 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.314585:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:0.0:1789126897.314587:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126897.314589:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cac00, rc 0) 00000100:00100000:0.0:1789126897.314740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:10746:x1876035258839680:12345-192.168.203.23@tcp:101:rm.0 Request processed in 862us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126897.314749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1789126897.322290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.322569:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258839936 00000100:00100000:3.0:1789126897.322583:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258839936 00000100:00100000:3.0:1789126897.322790:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1789126897.322804:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:10746:x1876035258839936:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:3.0:1789126897.322893:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789126897.322935:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cac00/0xa840b4da666eac62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c370 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.322967:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eac0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c354 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.322981:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:3.0:1789126897.322994:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eac23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c35b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323028:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:3.0:1789126897.323033:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126897.323069:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323089:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323102:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323115:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323124:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323130:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323282:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323291:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.323299:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789126897.324071:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789126897.324084:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322528435038ns, next at 323528432249ns, rc = 0 00010000:00010000:3.0:1789126897.324159:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324172:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324181:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324189:0:9524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324197:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324205:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324251:0:9524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789126897.324277:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324285:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324290:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324297:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.324302:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324310:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324331:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:3.0:1789126897.324333:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789126897.324547:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324558:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac77 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324585:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324592:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324598:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324604:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.324607:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324613:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324622:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:3.0:1789126897.324625:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.324628:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324634:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324790:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126897.324802:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324809:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126897.324820:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324827:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324837:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:0.0:1789126897.324841:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789126897.324844:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324850:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126897.324863:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126897.324865:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126897.324867:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789126897.324898:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002f9479c8 reply state 00000000df894990 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324914:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.324922:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff994103eaaa00) 00010000:00010000:3.0:1789126897.324925:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126897.324929:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126897.325092:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258839936:12345-192.168.203.23@tcp:36:rm.0 Request processed in 2287us (2814us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789126897.325103:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1789126897.331040:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126897.331168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840192 00000100:00100000:0.0:1789126897.331181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840192 00000100:00100000:0.0:1789126897.331267:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1789126897.331279:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258840192:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:0.0:1789126897.331756:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:10746:x1876035258840192:12345-192.168.203.23@tcp:35:rm.0 Request processed in 477us (769us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789126897.331767:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1789126897.337883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126897.337989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840448 00000100:00100000:3.0:1789126897.338002:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840448 00000100:00100000:3.0:1789126897.338081:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1789126897.338094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:10746:x1876035258840448:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:3.0:1789126897.338169:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789126897.338206:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eac3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c369 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338233:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eabdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c346 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338258:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f300) 00010000:00010000:3.0:1789126897.338277:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031c00/0xa840b4da666eab9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c338 expref: 17 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338310:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f800) 00010000:00010000:3.0:1789126897.338317:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126897.338347:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338362:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338374:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338388:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338395:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338403:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338507:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338516:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338522:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126897.338882:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789126897.338902:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338915:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338921:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338927:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.338932:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338941:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338951:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99423648f900) 00010000:00010000:3.0:1789126897.338954:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789126897.338957:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338963:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030000/0xa840b4da666eac93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338983:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338989:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338995:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.338999:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126897.339009:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.339015:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.339022:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648f500) 00010000:00010000:3.0:1789126897.339025:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126897.339027:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.339033:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eac85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126897.339045:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000013e4cb37 reply state 00000000fb3f5ee3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.339056:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126897.339062:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99423648ff00) 00010000:00010000:3.0:1789126897.339065:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126897.339067:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126897.339167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:10746:x1876035258840448:12345-192.168.203.23@tcp:36:rm.0 Request processed in 1074us (1298us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789126897.339176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00010000:00010000:1.0:1789126898.091017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126898.347875:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276750848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126898.347957:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276750976:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.347973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348035:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276751488:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348045:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276751360:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348099:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276752000:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276751872:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348170:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276752384:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348171:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789126898.348182:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276751104:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348222:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789126898.348231:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276750720:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348256:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276751616:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348322:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276752128:0@lo:400:kworker.0 00000100:00100000:2.0:1789126898.348333:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750720 00000100:00100000:1.0:1789126898.348337:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276751232:0@lo:400:kworker.0 00000100:00100000:2.0:1789126898.348344:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750720 00000100:00100000:3.0:1789126898.348350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.348386:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276751744:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750976 00000100:00100000:3.0:1789126898.348396:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750976 00000100:00100000:1.0:1789126898.348408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751488 00000100:00100000:1.0:1789126898.348439:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276752256:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751488 00000100:00100000:1.0:1789126898.348464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126898.348474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752000 00000100:00100000:3.0:1789126898.348477:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752000 00000100:00100000:1.0:1789126898.348498:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276750848 00000100:00100000:3.0:1789126898.348499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751616 00000100:00100000:3.0:1789126898.348504:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751616 00000100:00100000:1.0:1789126898.348504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276750848 00000100:00100000:2.0:1789126898.348528:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789126898.348534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752128 00000100:00100000:0.0:1789126898.348537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751872 00000100:00100000:3.0:1789126898.348538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752128 00000100:00100000:0.0:1789126898.348544:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751872 00000100:00100000:2.0:1789126898.348552:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276750720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348552:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789126898.348566:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276750848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126898.348567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751232 00000100:00100000:0.0:1789126898.348582:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752384 00000100:00100000:3.0:1789126898.348585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751232 00000100:00100000:0.0:1789126898.348588:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752384 00002000:00000024:1.0:1789126898.348589:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126898.348615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789126898.348620:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751744 00000100:00100000:0.0:1789126898.348625:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751744 00000100:00100000:3.0:1789126898.348627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276750976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126898.348639:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276750720:12345-0@lo:400:kworker.0 Request processed in 99us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126898.348688:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789126898.348707:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752256 00000100:00100000:0.0:1789126898.348713:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752256 00000100:00100000:1.0:1789126898.348718:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876035276750848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.348730:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789126898.348733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276750976:12345-0@lo:400:kworker.0 Request processed in 106us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126898.348737:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789126898.348749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789126898.348754:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276751872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348759:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751360 00000100:00100000:1.0:1789126898.348765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751360 00000100:00100000:3.0:1789126898.348773:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789126898.348783:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276751488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348801:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276751104 00000100:00100000:0.0:1789126898.348806:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276751872:12345-0@lo:400:kworker.0 Request processed in 56us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.348807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276751104 00000100:00100000:0.0:1789126898.348816:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789126898.348836:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789126898.348842:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789126898.348843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276751488:12345-0@lo:400:kworker.0 Request processed in 59us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.348848:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276751360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789126898.348857:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276752384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789126898.348889:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276752000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.348902:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276751360:12345-0@lo:400:kworker.0 Request processed in 57us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.348910:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789126898.348913:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276752384:12345-0@lo:400:kworker.0 Request processed in 59us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126898.348922:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789126898.348932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789126898.348934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276752000:12345-0@lo:400:kworker.0 Request processed in 45us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126898.348942:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789126898.348945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276751104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789126898.348957:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276751744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.348966:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789126898.348974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276751616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.349105:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276751104:12345-0@lo:400:kworker.0 Request processed in 164us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.349112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789126898.349133:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789126898.349141:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276752256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126898.349170:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276751744:12345-0@lo:400:kworker.0 Request processed in 217us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126898.349172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276751616:12345-0@lo:400:kworker.0 Request processed in 198us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126898.349186:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789126898.349189:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789126898.349193:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276752256:12345-0@lo:400:kworker.0 Request processed in 51us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.349202:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789126898.349208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789126898.349216:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276752128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.349260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276752128:12345-0@lo:400:kworker.0 Request processed in 45us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126898.349268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789126898.349285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789126898.349292:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276751232:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1789126898.349296:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323553646490ns, next at 324553643231ns, rc = 0 00000100:00100000:3.0:1789126898.349326:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276751232:12345-0@lo:400:kworker.0 Request processed in 34us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126898.349334:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1789126898.349378:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126898.349383:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126898.349393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126898.349396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126898.349413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276752512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126898.349449:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126898.349472:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752512 00000100:00100000:1.0:1789126898.349478:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752512 00000100:00100000:3.0:1789126898.349489:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276751104:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.349507:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789126898.349508:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99c000 x1876035276751616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349518:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276752512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126898.349522:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276751616:0@lo:400:kworker.0 00002000:00000024:1.0:1789126898.349533:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789126898.349539:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99f0c0 x1876035276752128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126898.349548:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276752128:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.349563:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276750976:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.349573:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276752512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126898.349579:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789126898.349618:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276750720:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.349632:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276751232:0@lo:400:kworker.0 00010000:00080000:1.0:1789126898.349642:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99ed00 x1876035276751744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349678:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276751744:0@lo:400:kworker.0 00010000:00080000:1.0:1789126898.349695:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99d2c0 x1876035276752256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349714:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276752256:0@lo:400:kworker.0 00000100:00100000:1.0:1789126898.349727:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276751360:0@lo:400:kworker.0 00010000:00080000:1.0:1789126898.349738:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e940 x1876035276751872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276751872:0@lo:400:kworker.0 00010000:00080000:1.0:1789126898.349754:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e1c0 x1876035276752384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349760:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276752384:0@lo:400:kworker.0 00010000:00080000:1.0:1789126898.349768:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040d21c0 x1876035276750848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126898.349781:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276750848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126898.349861:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276751488:0@lo:400:kworker.0 00000100:00100000:3.0:1789126898.349879:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276752000:0@lo:400:kworker.0 00010000:00080000:3.0:1789126898.349970:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410402a940 x1876035276752512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126898.349985:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276752512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789126899.114873:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126900.141607:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126900.395131:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126900.395157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276752640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126900.395240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126900.395311:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752640 00000100:00100000:0.0:1789126900.395319:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752640 00000100:00100000:0.0:1789126900.395369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789126900.395380:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276752640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126900.396518:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126900.396595:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276752640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1215us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126900.396613:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789126900.396690:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276752640:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789126900.544825:0:14367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789126900.906882:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126900.906907:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276752768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126900.906996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126900.907069:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276752896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126900.907096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126900.907140:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752768 00000100:00100000:2.0:1789126900.907148:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752768 00000100:00100000:2.0:1789126900.907205:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276752896 00000100:00100000:2.0:1789126900.907209:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276752896 00000100:00100000:2.0:1789126900.907238:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789126900.907249:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276752768:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126900.907270:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00002000:00000024:2.0:1789126900.907282:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126900.907285:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276752896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126900.907300:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126900.907353:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276752768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126900.907362:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789126900.907386:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126900.907930:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276752896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 647us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126900.907948:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1789126900.909737:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104100000 x1876035276752896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126900.909767:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276752896:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789126900.909784:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104818780 x1876035276752768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126900.909798:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276752768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789126901.164363:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789126901.446096:0:14415:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff85a763a0 20000000:00000080:1.0:1789126901.446115:0:14415:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994104822c00 uarg=0000000000000000 20000000:01000000:1.0:1789126901.446156:0:14415:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789126901.446163:0:14415:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789126901.446167:0:14415:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789126901.450494:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:3.0:1789126901.455917:0:14415:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789126901.460101:0:14415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:2.0:1789126901.460143:0:14415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:2.0:1789126901.460160:0:14415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:2.0:1789126901.460177:0:14415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789126901.460198:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460226:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab27 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460233:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab35 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460240:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab43 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460262:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460272:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460279:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460287:0:14415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460342:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460357:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.460375:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753024:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126901.460514:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460522:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 12 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.460531:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753152:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126901.460568:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.460588:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.460598:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753280:0@lo:104: 00000100:00100000:2.0:1789126901.460686:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126901.460784:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753280 00000100:00100000:3.0:1789126901.460794:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753280 00000100:00100000:3.0:1789126901.460853:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789126901.460864:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104819a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753280:12345-0@lo:104: 00010000:00010000:3.0:1789126901.460881:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.464505:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.464529:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 23 pid: 6507 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.464545:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753408:0@lo:104: 00000100:00100000:2.0:1789126901.464641:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126901.464797:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.464806:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.464815:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753536:0@lo:104: 00000100:00100000:2.0:1789126901.464839:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126901.465587:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.465598:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.465609:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753664:0@lo:104: 00000100:00100000:2.0:1789126901.465687:0:14415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789126901.467777:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789126901.467794:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104819a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753280:12345-0@lo:104: Request processed in 6926us (7139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126901.467809:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126901.468460:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753408 00000100:00100000:1.0:1789126901.468471:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753408 00000100:00100000:1.0:1789126901.468520:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753536 00000100:00100000:1.0:1789126901.468524:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753536 00000100:00100000:1.0:1789126901.468540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126901.468550:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:14415:x1876035276753408:12345-0@lo:104: 00010000:00010000:1.0:1789126901.468584:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468674:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789126901.468679:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+4:14415:x1876035276753408:12345-0@lo:104: Request processed in 132us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126901.468686:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789126901.468702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789126901.468708:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753536:12345-0@lo:104: 00010000:00010000:1.0:1789126901.468716:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468751:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789126901.468756:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753536:12345-0@lo:104: Request processed in 49us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126901.468761:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1789126901.468784:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789126901.468791:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468798:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148fa00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126901.468803:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468812:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126901.468819:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126901.468833:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126901.468877:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468884:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126901.468910:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468917:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148fa00/0xa840b4da666eab51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab58 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468931:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789126901.468935:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468940:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126901.468943:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468950:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126901.468956:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126901.468961:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126901.468973:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.468979:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126901.468995:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469001:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148ea00/0xa840b4da666eab43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469013:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126901.469015:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469021:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126901.469024:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469030:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126901.469036:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126901.469042:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789126901.469055:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469061:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789126901.469074:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469081:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166b800/0xa840b4da666eab35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab3c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126901.469090:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126901.469097:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126901.469099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126901.469114:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126901.469118:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126901.469131:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276753920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126901.469169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126901.469203:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126901.469208:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276753792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126901.469485:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104360840 going to sleep for 11 seconds 00000100:00100000:2.0:1789126901.469509:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753280:0@lo:104: 00000100:00100000:2.0:1789126901.469519:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104819e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753408:0@lo:104: 00000100:00100000:2.0:1789126901.469527:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753536:0@lo:104: 00000100:00100000:3.0:1789126901.469548:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753664 00000100:00100000:3.0:1789126901.469554:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753664 00000100:00100000:2.0:1789126901.469598:0:13968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789126901.469609:0:13968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753664:12345-0@lo:104: 00010000:00010000:2.0:1789126901.469617:0:13968:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469686:0:13968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789126901.469692:0:13968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:def09dbb-e047-4ff8-a277-077b6777bba2+3:14415:x1876035276753664:12345-0@lo:104: Request processed in 87us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126901.469698:0:13968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1789126901.469716:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126901.469720:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469727:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126901.469729:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469736:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126901.469742:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126901.469757:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789126901.469777:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469782:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126901.469790:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469796:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666eab27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666eab2e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.469809:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126901.469810:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126901.469812:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126901.469844:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276754176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126901.469872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126901.469893:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126901.469899:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276754048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126901.469919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126901.469989:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753920 00000100:00100000:2.0:1789126901.469993:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753920 00010000:00010000:2.0:1789126901.470011:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 24 pid: 6507 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.470029:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754176 00000100:00100000:2.0:1789126901.470031:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754176 00010000:00010000:2.0:1789126901.470041:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 25 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.470071:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754048 00000100:00100000:2.0:1789126901.470075:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754048 00010000:00010000:2.0:1789126901.470100:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 26 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126901.470102:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753024:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126901.470122:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753664:0@lo:104: 00000100:00100000:2.0:1789126901.470127:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789126901.470138:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+26:3642:x1876035276753920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126901.470148:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126901.470153:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 26 pid: 6507 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470162:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 26 pid: 6507 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470175:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eab4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab43 expref: 26 pid: 6507 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470187:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126901.470227:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+25:3642:x1876035276753920:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126901.470234:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789126901.470251:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789126901.470259:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276754176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126901.470267:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126901.470271:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 24 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470279:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 24 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470296:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cbc00/0xa840b4da666eab2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab27 expref: 24 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470304:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126901.470341:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+23:3640:x1876035276754176:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126901.470347:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789126901.470385:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126901.470390:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+22:3640:x1876035276754048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126901.470397:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126901.470402:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 22 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470409:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 22 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.470418:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb200/0xa840b4da666eab3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab35 expref: 22 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126901.470484:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276754176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789126901.470644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126901.470692:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276753920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126901.470745:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276753792 00000100:00100000:0.0:1789126901.470749:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276753792 00010000:00010000:0.0:1789126901.470767:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126901.470797:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789126901.470803:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276753792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126901.470811:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126901.470814:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126901.470822:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126901.470834:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3200/0xa840b4da666eab58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666eab51 expref: 23 pid: 6505 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126901.470856:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126901.470893:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+22:3642:x1876035276753792:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126901.470900:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789126901.470929:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276753792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789126901.470960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1789126901.471010:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126901.471045:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:def09dbb-e047-4ff8-a277-077b6777bba2+20:3640:x1876035276754048:12345-0@lo:103:ldlm_bl.0 Request processed in 653us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126901.471053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126901.471058:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789126901.474115:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840704 00000100:00100000:2.0:1789126901.474134:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840704 00000100:00100000:3.0:1789126901.474168:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104818780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14415:1876035276753152:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126901.474187:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 13 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.474223:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840576 00010000:00010000:3.0:1789126901.474230:0:14415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.474243:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840576 00010000:00010000:2.0:1789126901.474260:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 14 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126901.474277:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1789126901.474286:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c860d42f-307d-4b4b-a338-6aeff2da97ec+14:2393:x1876035258840704:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126901.474301:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126901.474307:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 14 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474317:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 14 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474337:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f000/0xa840b4da666eab5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c323 expref: 14 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474354:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126901.474516:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258840704:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 229us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126901.474524:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1789126901.474542:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1789126901.474549:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:2393:x1876035258840576:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126901.474560:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126901.474565:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474574:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474598:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166ac00/0xa840b4da666eab66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c32a expref: 12 pid: 6507 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474613:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474621:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474636:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474643:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474674:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474681:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474688:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126901.474693:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474701:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474714:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126901.474733:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126901.474752:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258840576:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 204us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126901.474758:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1789126901.474799:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276754048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789126901.475850:0:14415:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126901.475879:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126901.475887:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3400/0xa840b4da666eac9a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126901.932606:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126901.932633:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276754304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126901.932728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126901.932786:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754304 00000100:00100000:1.0:1789126901.932793:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754304 00000100:00100000:1.0:1789126901.932848:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789126901.932859:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276754304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126901.932896:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126901.932949:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276754304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126901.932956:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789126901.933002:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276754304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126902.096282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126902.096327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126902.096348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126902.096371:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126902.096393:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126902.096422:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840832 00000100:00100000:2.0:1789126902.096432:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840832 00000100:00100000:2.0:1789126902.096486:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258840960 00000100:00100000:2.0:1789126902.096489:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258840960 00000100:00100000:2.0:1789126902.096501:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841216 00000100:00100000:2.0:1789126902.096503:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841216 00000100:00100000:2.0:1789126902.096515:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841344 00000100:00100000:2.0:1789126902.096530:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841344 00000100:00100000:2.0:1789126902.096550:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:2.0:1789126902.096561:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:2394:x1876035258840832:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126902.096780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:1.0:1789126902.096790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258840960:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126902.096830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258840960:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.096846:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:1.0:1789126902.096865:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:1.0:1789126902.096872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258841216:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126902.096898:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258841216:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.096904:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:1.0:1789126902.096918:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:1.0:1789126902.096924:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258841344:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126902.096947:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258841344:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.096952:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:1.0:1789126902.096969:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841088 00000100:00100000:1.0:1789126902.096972:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841088 00000100:00100000:1.0:1789126902.097011:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1789126902.097018:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258841088:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126902.097046:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258841088:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.097052:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:2.0:1789126902.101581:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:2394:x1876035258840832:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 5008us (5305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.101597:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00080000:2.0:1789126902.101663:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789126902.101669:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126902.101673:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789126902.188458:0:14464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff94cb9440 20000000:00000080:0.0:1789126902.188475:0:14464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99422fa90000 uarg=0000000000000000 20000000:01000000:0.0:1789126902.188521:0:14464:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789126902.188528:0:14464:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789126902.188532:0:14464:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00010000:00010000:1.0:1789126902.188889:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789126902.189041:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:0.0:1789126902.189270:0:14464:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789126902.189332:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:0.0:1789126902.189362:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:0.0:1789126902.189377:0:14464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:0.0:1789126902.189388:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789126902.189410:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189427:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189438:0:14464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189445:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189451:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189469:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189475:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbe00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126902.189479:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189488:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189501:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189509:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.189516:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cbe00/0xa840b4da666eaca1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126902.957942:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789126902.957953:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994102d1e800 from 13 10000000:01000000:3.0:1789126902.957960:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789126902.958015:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126902.958162:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126902.958174:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126902.958214:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789126902.958294:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126902.958440:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126902.958561:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754432 00000100:00100000:0.0:1789126902.959396:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754432 00000100:00100000:0.0:1789126902.959521:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789126902.959534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+20:6509:x1876035276754432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126902.959553:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126902.959585:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca800/0xa840b4da666eacaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaca8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.959771:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca800/0xa840b4da666eacaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaca8 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.959802:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca800/0xa840b4da666eacaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaca8 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.959811:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca800, rc 0) 00000100:00100000:0.0:1789126902.959885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276754432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 354us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126902.959892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789126902.959975:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126902.959994:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.960004:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126902.960110:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.960143:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.961080:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.961307:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754560 00000100:00100000:2.0:1789126902.961324:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754560 00000100:00100000:2.0:1789126902.961362:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789126902.961371:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276754560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.961518:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276754560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.961525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789126902.961686:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.961741:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.961784:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.961797:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.961946:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754688 00000100:00100000:2.0:1789126902.961951:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754688 00000100:00100000:2.0:1789126902.961970:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789126902.961976:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276754688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.962073:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276754688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.962081:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789126902.962258:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276754688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.962474:0:14477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14477:1876035276754816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126902.962510:0:14477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.962528:0:14477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941043349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.962766:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754816 00000100:00100000:2.0:1789126902.962771:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754816 00000100:00100000:2.0:1789126902.962791:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789126902.962797:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14477:x1876035276754816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126902.962878:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14477:x1876035276754816:12345-0@lo:502:llog_process_th.0 Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.962885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789126902.962974:0:14477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14477:1876035276754816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126902.962996:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126902.963005:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.963008:0:14477:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789126902.963014:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994102d1e800 00000020:00000080:1.0:1789126902.963017:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789126902.963087:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126902.963232:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.963234:0:14477:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789126902.963238:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126902.963240:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.963242:0:14477:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789126902.963245:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994102d1e800 00000020:00000080:1.0:1789126902.963247:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126902.963292:0:14477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14477:1876035276754944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126902.963330:0:14477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.963354:0:14477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941043349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126902.964872:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276754944 00000100:00100000:1.0:1789126902.964881:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276754944 00000100:00100000:1.0:1789126902.964922:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789126902.964932:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14477:x1876035276754944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126902.965371:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+21:14477:x1876035276754944:12345-0@lo:502:llog_process_th.0 Request processed in 439us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.965380:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789126902.965424:0:14477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14477:1876035276754944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126902.965474:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126902.965483:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.965485:0:14477:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789126902.965490:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789126902.966786:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789126902.966821:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126902.966834:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.966847:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126902.966859:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789126902.966861:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994220b43000 from 13 10000000:01000000:0.0:1789126902.966865:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789126902.966991:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.967000:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.967010:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.967054:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.967122:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789126902.967497:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789126902.967687:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789126902.967727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755072 00000100:00100000:1.0:1789126902.967734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755072 00000100:00100000:1.0:1789126902.967788:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789126902.967797:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+21:6509:x1876035276755072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126902.967810:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126902.967825:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166ac00/0xa840b4da666eacbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eacb6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.967848:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166ac00/0xa840b4da666eacbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eacb6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.967860:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166ac00/0xa840b4da666eacbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eacb6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.967870:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166ac00, rc 0) 00000001:00080000:2.0:1789126902.968257:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789126902.968288:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789126902.968419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 620us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126902.968429:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789126902.968474:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126902.968494:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.968501:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276755200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789126902.968516:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.968521:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968536:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.968541:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968549:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968558:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126902.968563:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968570:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968589:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff994103eaaa00) 00010000:00010000:1.0:1789126902.968592:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126902.968597:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968604:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eabf2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.968626:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755328:0@lo:501:ll_cfg_requeue.0 00010000:00010000:1.0:1789126902.968627:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968799:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968819:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968825:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126902.968828:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968835:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968844:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff994103eaa000) 00010000:00010000:1.0:1789126902.968848:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126902.968851:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968857:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666eac07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968878:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968884:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968889:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968893:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126902.968896:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968912:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968932:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff994103eaaa00) 00010000:00010000:1.0:1789126902.968935:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126902.968938:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968944:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eac70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968962:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968967:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968973:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968979:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126902.968982:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968988:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.968995:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99423648ff00) 00010000:00010000:1.0:1789126902.968998:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126902.969001:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.969017:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eac8c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.969336:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.969629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755328 00000100:00100000:1.0:1789126902.969737:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755328 00000100:00100000:0.0:1789126902.969743:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.969749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.969797:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789126902.969798:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755200 00000100:00100000:1.0:1789126902.969806:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755200 00000100:00100000:0.0:1789126902.969816:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.969858:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789126902.969866:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276755200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789126902.969887:0:8906:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789126902.970013:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3e8f0, atime: 0x6aa3e8f0, ctime: 0x6aa3e8f0, blocks: 0x0 00010000:00010000:1.0:1789126902.970021:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970034:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1789126902.970039:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126902.970045:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970062:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970071:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970078:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970174:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789126902.970378:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 569us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126902.970388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789126902.970497:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276755200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 630us (753us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789126902.970504:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789126902.970533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789126902.970547:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126902.970553:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970561:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126902.970565:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970573:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970588:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970595:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b6237c/0xa840b4da666eacc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126902.970615:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126902.970617:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126902.970619:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789126902.970831:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9941042d8f00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789126902.970847:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276755200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789126902.970899:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.971082:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.971196:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.971240:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334240 going to sleep for 11 seconds 00000100:00100000:0.0:1789126902.974036:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755456 00000100:00100000:0.0:1789126902.974050:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755456 00000100:00100000:0.0:1789126902.974115:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789126902.974124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.974294:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126902.974316:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789126902.974394:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.974679:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14479:1876035276755584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126902.974738:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.974777:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126902.974894:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755584 00000100:00100000:3.0:1789126902.974909:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755584 00000100:00100000:3.0:1789126902.974988:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1789126902.975001:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:14479:x1876035276755584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126902.975194:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:14479:x1876035276755584:12345-0@lo:502:llog_process_th.0 Request processed in 195us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126902.975224:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789126902.975231:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14479:1876035276755584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126902.975269:0:14479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126902.975281:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126902.975286:0:14479:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789126902.975296:0:14479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994220b43000 00000020:00000080:0.0:1789126902.975299:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789126902.975493:0:14479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126902.975497:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126902.975499:0:14479:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789126902.975502:0:14479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126902.975505:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126902.975506:0:14479:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789126902.975509:0:14479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994220b43000 00000020:00000080:0.0:1789126902.975510:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789126902.977800:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14479:1876035276755712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126902.977901:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.977941:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.978053:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755712 00000100:00100000:2.0:1789126902.978068:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755712 00000100:00100000:2.0:1789126902.978116:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789126902.978125:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:14479:x1876035276755712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126902.978253:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+22:14479:x1876035276755712:12345-0@lo:502:llog_process_th.0 Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.978262:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789126902.978517:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14479:1876035276755712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126902.978545:0:14479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126902.978553:0:14479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126902.978555:0:14479:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789126902.978567:0:14479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789126902.979323:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:2.0:1789126902.979350:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789126902.979360:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.979373:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126902.979384:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789126902.979387:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423d256000 from 13 10000000:01000000:2.0:1789126902.979390:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789126902.979506:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.979515:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.979524:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126902.979546:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.979599:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126902.979802:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104360900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126902.979843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755840 00000100:00100000:3.0:1789126902.979851:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755840 00000100:00100000:3.0:1789126902.979895:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1789126902.979906:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+22:6509:x1876035276755840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789126902.979920:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126902.979936:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030000/0xa840b4da666eacd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eaccb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126902.979961:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030000/0xa840b4da666eacd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eaccb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126902.979972:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030000/0xa840b4da666eacd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eaccb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126902.979981:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030000, rc 0) 00000100:00100000:3.0:1789126902.980104:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276755840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126902.980112:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789126902.980170:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126902.980180:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.980187:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.980250:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.980281:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.980348:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.980378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276755968 00000100:00100000:2.0:1789126902.980390:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276755968 00000100:00100000:2.0:1789126902.980535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789126902.980548:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276755968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.980759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994202aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276755968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.980766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789126902.980819:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276755968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.980849:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.980910:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.981012:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126902.981044:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756096 00000100:00100000:3.0:1789126902.981048:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756096 00000100:00100000:3.0:1789126902.984308:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1789126902.984333:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276756096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789126902.984510:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421219b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276756096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126902.984518:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789126902.984677:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126902.984888:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14481:1876035276756224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126902.984935:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.987424:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.987632:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756224 00000100:00100000:2.0:1789126902.987642:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756224 00000100:00100000:2.0:1789126902.987713:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1789126902.987724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14481:x1876035276756224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126902.987884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14481:x1876035276756224:12345-0@lo:502:llog_process_th.0 Request processed in 161us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.987892:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000040:00080000:2.0:1789126902.988721:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789126902.988898:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14481:1876035276756224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126902.988945:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126902.988959:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.988962:0:14481:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789126902.988971:0:14481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423d256000 00000020:00000080:1.0:1789126902.988974:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789126902.989049:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126902.989052:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.989054:0:14481:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789126902.989057:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789126902.989059:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.989060:0:14481:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789126902.989064:0:14481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423d256000 00000020:00000080:1.0:1789126902.989066:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789126902.989132:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14481:1876035276756352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126902.989194:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126902.989235:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.990301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756352 00000100:00100000:2.0:1789126902.990311:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756352 00000100:00100000:2.0:1789126902.990368:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789126902.990378:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14481:x1876035276756352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789126902.990591:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942182da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:14481:x1876035276756352:12345-0@lo:502:llog_process_th.0 Request processed in 214us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.990599:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789126902.991903:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14481:1876035276756352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789126902.991939:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789126902.991947:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789126902.991950:0:14481:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789126902.991955:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789126902.992331:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789126902.992364:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789126902.992376:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.992386:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126902.992478:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789126902.992481:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994212236800 from 13 10000000:01000000:0.0:1789126902.992484:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789126902.992520:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.992544:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.992555:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.992579:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.992636:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.992699:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.993526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756480 00000100:00100000:2.0:1789126902.993534:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756480 00000100:00100000:2.0:1789126902.993590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789126902.993600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+23:6509:x1876035276756480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789126902.993613:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126902.993633:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3800/0xa840b4da666eace0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eacd9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.993677:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3800/0xa840b4da666eace0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eacd9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.993688:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3800/0xa840b4da666eace0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eacd9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126902.993697:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3800, rc 0) 00000100:00100000:2.0:1789126902.993751:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276756480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.993757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789126902.993933:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126902.993950:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126902.993960:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126902.994023:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.994054:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.994089:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.994162:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756608 00000100:00100000:2.0:1789126902.994167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756608 00000100:00100000:2.0:1789126902.994196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789126902.994211:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276756608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.994325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276756608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.994331:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1789126902.994491:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.994519:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.994561:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.994587:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789126902.995591:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756736 00000100:00100000:2.0:1789126902.995600:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756736 00000100:00100000:2.0:1789126902.995674:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789126902.995684:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276756736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789126902.995807:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:6509:x1876035276756736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126902.995814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789126902.995916:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:def09dbb-e047-4ff8-a277-077b6777bba2:6509:1876035276756736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126902.999253:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14483:1876035276756864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126902.999576:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126902.999620:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126903.000697:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756864 00000100:00100000:3.0:1789126903.000719:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756864 00000100:00100000:3.0:1789126903.000780:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789126903.000791:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14483:x1876035276756864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789126903.000945:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:14483:x1876035276756864:12345-0@lo:502:llog_process_th.0 Request processed in 155us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.000953:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789126903.002398:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14483:1876035276756864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126903.002440:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126903.002450:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126903.002453:0:14483:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789126903.002462:0:14483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994212236800 00000020:00000080:0.0:1789126903.002466:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789126903.002533:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126903.002537:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126903.002539:0:14483:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789126903.002542:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789126903.002545:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126903.002546:0:14483:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789126903.002550:0:14483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994212236800 00000020:00000080:0.0:1789126903.002552:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789126903.002607:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14483:1876035276756992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789126903.002908:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126903.002962:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236565cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126903.003091:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276756992 00000100:00100000:1.0:1789126903.003099:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276756992 00000100:00100000:1.0:1789126903.003155:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789126903.003165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:14483:x1876035276756992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789126903.003298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:14483:x1876035276756992:12345-0@lo:502:llog_process_th.0 Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.003307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789126903.003498:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:def09dbb-e047-4ff8-a277-077b6777bba2:14483:1876035276756992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789126903.003521:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789126903.003526:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789126903.003528:0:14483:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789126903.003533:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789126903.003731:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789126903.003752:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789126903.003763:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126903.003774:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789126903.005168:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789126903.210881:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126903.309108:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126903.309290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841472 00000100:00100000:1.0:1789126903.309305:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841472 00000100:00100000:1.0:1789126903.309379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 418 00000100:00100000:1.0:1789126903.309390:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:6161:x1876035258841472:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789126903.309406:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126903.309425:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420166b400/0xa840b4da666eace7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c377 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126903.309453:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420166b400/0xa840b4da666eace7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c377 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126903.309463:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420166b400/0xa840b4da666eace7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c377 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126903.309488:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166b400, rc 0) 00000100:00100000:1.0:1789126903.309556:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258841472:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 168us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.309564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 418 00000100:00100000:2.0:1789126903.311912:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126903.313166:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841600 00000100:00100000:3.0:1789126903.313180:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841600 00000100:00100000:3.0:1789126903.313262:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 419 00000100:00100000:3.0:1789126903.313272:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258841600:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789126903.313527:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258841600:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 256us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.313537:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 419 00000100:00100000:2.0:1789126903.316552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126903.318795:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841728 00000100:00100000:1.0:1789126903.318815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841728 00000100:00100000:1.0:1789126903.318990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 420 00000100:00100000:1.0:1789126903.319004:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258841728:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789126903.319241:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258841728:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 240us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.319314:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 420 00000100:00100000:2.0:1789126903.323620:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126903.323742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841856 00000100:00100000:3.0:1789126903.323751:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841856 00000100:00100000:3.0:1789126903.323809:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 421 00000100:00100000:3.0:1789126903.323820:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:11030:x1876035258841856:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789126903.324127:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:11030:x1876035258841856:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 308us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.324146:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 421 00000100:00100000:2.0:1789126903.327382:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126903.327519:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258841984 00000100:00100000:1.0:1789126903.327530:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258841984 00000100:00100000:1.0:1789126903.327625:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 422 00000100:00100000:1.0:1789126903.327635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:11030:x1876035258841984:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789126903.327819:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:11030:x1876035258841984:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 184us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.327828:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 422 00000100:00100000:2.0:1789126903.334718:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126903.335384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842112 00000100:00100000:0.0:1789126903.335393:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842112 00000100:00100000:0.0:1789126903.335449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 423 00000100:00100000:0.0:1789126903.335458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:6161:x1876035258842112:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789126903.335489:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126903.335506:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cac00/0xa840b4da666eacee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c37e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126903.335532:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cac00/0xa840b4da666eacee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c37e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126903.335543:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cac00/0xa840b4da666eacee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c37e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126903.335552:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cac00, rc 0) 00000100:00100000:0.0:1789126903.335820:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258842112:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 361us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126903.335827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 423 00000100:00100000:2.0:1789126903.342057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126903.342361:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842240 00000100:00100000:1.0:1789126903.342372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842240 00000100:00100000:1.0:1789126903.342425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 424 00000100:00100000:1.0:1789126903.342435:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258842240:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789126903.342600:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258842240:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 165us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.342626:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 424 00000100:00100000:2.0:1789126903.346318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126903.346416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842368 00000100:00100000:0.0:1789126903.346427:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842368 00000100:00100000:0.0:1789126903.346490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 425 00000100:00100000:0.0:1789126903.346501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258842368:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789126903.346692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:6161:x1876035258842368:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 192us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126903.346700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 425 00000100:00100000:0.0:1789126903.350354:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126903.350748:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842496 00000100:00100000:3.0:1789126903.350760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842496 00000100:00100000:3.0:1789126903.350856:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 426 00000100:00100000:3.0:1789126903.350867:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:11033:x1876035258842496:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789126903.351024:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:11033:x1876035258842496:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 159us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.351040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 426 00000100:00100000:2.0:1789126903.355245:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126903.355497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842624 00000100:00100000:1.0:1789126903.355508:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842624 00000100:00100000:1.0:1789126903.355613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 427 00000100:00100000:1.0:1789126903.355624:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:11033:x1876035258842624:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789126903.355816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:11033:x1876035258842624:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 194us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.355825:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 427 00000100:00100000:1.0:1789126903.466840:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276757120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126903.466924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126903.466958:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276757248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126903.467563:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757120 00000100:00100000:1.0:1789126903.467572:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757120 00000100:00100000:1.0:1789126903.467623:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789126903.467632:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276757120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126903.467679:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126903.467726:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276757120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.467733:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1789126903.467753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126903.467777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.467787:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276757120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126903.469558:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757248 00000100:00100000:3.0:1789126903.469575:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757248 00000100:00100000:3.0:1789126903.469680:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126903.469694:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276757248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126903.469724:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126903.469829:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276757248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.469838:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126903.469907:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276757248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126903.470319:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276757376:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470392:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276757888:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470470:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276758400:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470516:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789126903.470521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276757504:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470567:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276758016:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470604:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276758528:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126903.470676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757376 00000100:00100000:1.0:1789126903.470680:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757376 00000100:00100000:1.0:1789126903.470714:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757888 00000100:00100000:1.0:1789126903.470717:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757888 00000100:00100000:1.0:1789126903.470737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758400 00000100:00100000:1.0:1789126903.470739:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758400 00000100:00100000:1.0:1789126903.470757:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758016 00000100:00100000:1.0:1789126903.470760:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758016 00000100:00100000:1.0:1789126903.470775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758528 00000100:00100000:1.0:1789126903.470777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758528 00000100:00100000:1.0:1789126903.470790:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789126903.470798:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276757376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276757376:12345-0@lo:400:kworker.0 Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.470850:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789126903.470866:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789126903.470872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276757888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.470899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276757888:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.470915:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789126903.471145:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276757760:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126903.471211:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276758272:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126903.471258:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789126903.471265:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276757632:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126903.471316:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276758144:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126903.471371:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757504 00000100:00100000:3.0:1789126903.471375:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757504 00000100:00100000:3.0:1789126903.471402:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757760 00000100:00100000:3.0:1789126903.471405:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757760 00000100:00100000:3.0:1789126903.471418:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789126903.471425:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276757504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471461:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276757504:12345-0@lo:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.471467:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789126903.471480:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789126903.471485:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276757760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471514:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276757760:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.471520:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789126903.471536:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758272 00000100:00100000:3.0:1789126903.471539:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758272 00000100:00100000:3.0:1789126903.471565:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758144 00000100:00100000:3.0:1789126903.471568:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758144 00000100:00100000:3.0:1789126903.471586:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789126903.471592:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276758272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471620:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276758272:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.471628:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789126903.471638:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789126903.471643:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276758144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471703:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276758144:12345-0@lo:400:kworker.0 Request processed in 59us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.471710:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789126903.471761:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e940 x1876035276758144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126903.471779:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276758144:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471789:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276757760:0@lo:400:kworker.0 00010000:00080000:3.0:1789126903.471799:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99d2c0 x1876035276758272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126903.471809:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276758272:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.471859:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276757632 00000100:00100000:3.0:1789126903.471863:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276757632 00000100:00100000:3.0:1789126903.471885:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789126903.471892:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276758400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789126903.472283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276758016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276758016:12345-0@lo:400:kworker.0 Request processed in 41us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.472327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789126903.472338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789126903.472344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276758528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276758528:12345-0@lo:400:kworker.0 Request processed in 27us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.472376:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789126903.472387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789126903.472393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276757632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472427:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276757632:12345-0@lo:400:kworker.0 Request processed in 35us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126903.472434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1789126903.472466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126903.472471:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126903.472474:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126903.472505:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276757504:0@lo:400:kworker.0 00010000:00080000:1.0:1789126903.472520:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99e1c0 x1876035276758016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126903.472530:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276758016:0@lo:400:kworker.0 00010000:00080000:1.0:1789126903.472541:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec21c0 x1876035276758528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126903.472559:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276758528:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472573:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276757376:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472584:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276757888:0@lo:400:kworker.0 00000100:00100000:1.0:1789126903.472594:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276758400:0@lo:400:kworker.0 00000100:00100000:2.0:1789126903.472728:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276757632:0@lo:400:kworker.0 00000100:00100000:3.0:1789126903.473314:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276758400:12345-0@lo:400:kworker.0 Request processed in 39us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126903.473325:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000040:00080000:2.0:1789126904.043722:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789126904.044083:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789126904.234819:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126905.260128:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126905.514971:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126905.515845:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276758656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126905.516321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126905.516581:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758656 00000100:00100000:3.0:1789126905.516589:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758656 00000100:00100000:3.0:1789126905.516668:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789126905.516681:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276758656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126905.516717:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126905.516776:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276758656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126905.516796:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789126905.517080:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276758656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126906.030233:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126906.030258:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104313840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276758784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126906.030332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126906.031320:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758784 00000100:00100000:3.0:1789126906.031329:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758784 00000100:00100000:3.0:1789126906.031400:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789126906.031411:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276758784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126906.031443:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126906.031501:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276758784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126906.031508:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1789126906.031566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104313840 x1876035276758784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126906.031584:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104313840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276758784:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789126906.031708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126906.034087:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941042d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276758912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126906.034162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126906.034304:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276758912 00000100:00100000:2.0:1789126906.034312:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276758912 00000100:00100000:2.0:1789126906.034384:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789126906.034395:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276758912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126906.034423:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126906.034473:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276758912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126906.034481:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789126906.034589:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126906.034623:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941042d9e00 x1876035276758912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126906.034641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941042d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276758912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789126906.284519:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126907.051244:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126907.051269:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104313840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276759040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126907.051355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126907.051572:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759040 00000100:00100000:2.0:1789126907.051592:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759040 00000100:00100000:2.0:1789126907.051674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789126907.051685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276759040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126907.051718:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789126907.051782:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276759040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126907.051789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789126907.051922:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104313840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276759040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126907.214874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126907.214921:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126907.215001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842880 00000100:00100000:1.0:1789126907.215017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842880 00000100:00100000:1.0:1789126907.215117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:1.0:1789126907.215133:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258842880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126907.215150:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258842752 00000100:00100000:3.0:1789126907.215161:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258842752 00000100:00100000:3.0:1789126907.215236:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 428 00000100:00100000:1.0:1789126907.215238:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258842880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 105us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126907.215252:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258842752:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126907.215276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:3.0:1789126907.215342:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258842752:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 93us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126907.215352:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 428 00000100:00080000:2.0:1789126907.215722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126907.223143:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126907.223491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126907.223522:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126907.223571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126907.223946:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843392 00000100:00100000:0.0:1789126907.223963:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843392 00000100:00100000:0.0:1789126907.224091:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843008 00000100:00100000:0.0:1789126907.224095:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843008 00000100:00100000:0.0:1789126907.224115:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843264 00000100:00100000:0.0:1789126907.224117:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843264 00000100:00100000:0.0:1789126907.224142:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:0.0:1789126907.224157:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258843392:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126907.224275:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258843392:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 121us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126907.224285:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:1.0:1789126907.224337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:1.0:1789126907.224367:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:2.0:1789126907.224457:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126907.224465:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126907.224470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 114us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126907.224772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843136 00000100:00100000:3.0:1789126907.224779:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843136 00000100:00100000:3.0:1789126907.224823:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:3.0:1789126907.224832:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126907.224873:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (5705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126907.224892:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00080000:3.0:1789126907.224915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126907.228893:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:0.0:1789126907.228927:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258843264:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126907.229235:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104818780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258843264:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 326us (5662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126907.229246:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:1.0:1789126907.233402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 233 00010000:00010000:1.0:1789126907.306980:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126908.330826:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126908.587076:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126908.587111:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276759296:0@lo:400:kworker.0 00000100:00100000:0.0:1789126908.587260:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276759424:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.587531:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276759680:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.587580:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276759552:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.590105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.590127:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.590237:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276760064:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.590238:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.590294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126908.590324:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276760704:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.590539:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.590569:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276760576:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.590591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.590620:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126908.590627:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276760960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126908.590691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126908.590739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.590740:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760960 00000100:00100000:2.0:1789126908.590758:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760960 00000100:00100000:3.0:1789126908.590849:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789126908.590860:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276759808:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.590895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126908.592038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126908.592083:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276759168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126908.592114:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126908.592190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759680 00000100:00100000:1.0:1789126908.592199:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759680 00000100:00100000:0.0:1789126908.592259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126908.592884:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276760320:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.592929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126908.592953:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276760832:0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.592978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126908.593523:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759168 00000100:00100000:2.0:1789126908.593532:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759168 00000100:00100000:2.0:1789126908.593563:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789126908.593572:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276760960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789126908.593606:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126908.593771:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760192 00000100:00100000:3.0:1789126908.593776:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760192 00000100:00100000:3.0:1789126908.593801:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760704 00000100:00100000:3.0:1789126908.593804:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760704 00000100:00100000:3.0:1789126908.593815:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760320 00000100:00100000:3.0:1789126908.593818:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760320 00000100:00100000:3.0:1789126908.593827:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760832 00000100:00100000:3.0:1789126908.593829:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760832 00000100:00100000:3.0:1789126908.593840:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789126908.593847:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276760192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.593904:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276760960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 334us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126908.593912:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789126908.593929:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789126908.593937:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876035276759168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126908.593947:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126908.593983:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876035276759168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126908.593988:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789126908.594236:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276760192:12345-0@lo:400:kworker.0 Request processed in 389us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594254:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789126908.594469:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789126908.594477:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276760704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.594512:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276760704:12345-0@lo:400:kworker.0 Request processed in 37us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594518:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789126908.594530:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789126908.594536:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276760320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.594564:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276760320:12345-0@lo:400:kworker.0 Request processed in 28us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594569:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789126908.594578:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789126908.594583:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276760832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.594606:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276760832:12345-0@lo:400:kworker.0 Request processed in 23us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594612:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789126908.594634:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759552 00000100:00100000:3.0:1789126908.594638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759552 00000100:00100000:3.0:1789126908.594707:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759808 00000100:00100000:3.0:1789126908.594711:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759808 00000100:00100000:3.0:1789126908.594725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789126908.594731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276759552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.594763:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104819e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276759552:12345-0@lo:400:kworker.0 Request processed in 33us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789126908.594788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789126908.594794:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276759808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126908.594835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276759808:12345-0@lo:400:kworker.0 Request processed in 41us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126908.594840:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789126908.594862:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126908.594866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126908.597014:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276759936:0@lo:400:kworker.0 00000100:00100000:0.0:1789126908.597503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126908.599700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760064 00000100:00100000:1.0:1789126908.599726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760064 00000100:00100000:1.0:1789126908.599850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760576 00000100:00100000:1.0:1789126908.599854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760576 00000100:00100000:1.0:1789126908.599874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759424 00000100:00100000:1.0:1789126908.599877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759424 00000100:00100000:1.0:1789126908.599899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789126908.599912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276759680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600038:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276759680:12345-0@lo:400:kworker.0 Request processed in 128us (9947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.600046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789126908.600066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789126908.600096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276760064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600133:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104818b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276760064:12345-0@lo:400:kworker.0 Request processed in 40us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.600140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789126908.600152:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789126908.600159:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276760576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600198:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276760576:12345-0@lo:400:kworker.0 Request processed in 40us (9605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.600204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789126908.600216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789126908.600222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276759424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276759424:12345-0@lo:400:kworker.0 Request processed in 30us (8000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.600258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789126908.600308:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759296 00000100:00100000:1.0:1789126908.600320:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759296 00000100:00100000:1.0:1789126908.600356:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789126908.600363:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276759296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276759296:12345-0@lo:400:kworker.0 Request processed in 37us (8366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.600406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00080000:1.0:1789126908.600443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126908.600492:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276759296:0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.600532:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410402bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276759168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126908.602234:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276760960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126908.602251:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276759552:0@lo:400:kworker.0 00010000:00080000:2.0:1789126908.602275:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80b40 x1876035276760064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126908.602286:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276760064:0@lo:400:kworker.0 00010000:00080000:2.0:1789126908.602297:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e792c0 x1876035276760576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126908.602305:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276760576:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.602499:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276759808:0@lo:400:kworker.0 00010000:00080000:2.0:1789126908.602527:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa821c0 x1876035276760320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126908.602536:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276760320:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.602545:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276760832:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.602556:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276759680:0@lo:400:kworker.0 00010000:00080000:2.0:1789126908.602566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80780 x1876035276760192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126908.602573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276760192:0@lo:400:kworker.0 00000100:00100000:2.0:1789126908.602583:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276760704:0@lo:400:kworker.0 00000001:00080000:2.0:1789126908.603896:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789126908.605485:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276760448:0@lo:400:kworker.0 00000100:00100000:0.0:1789126908.605560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126908.605613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276759936 00000100:00100000:0.0:1789126908.605629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276759424:0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.605679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276759936 00000100:00100000:1.0:1789126908.605786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276760448 00000100:00100000:1.0:1789126908.605791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276760448 00000100:00100000:1.0:1789126908.605905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789126908.605919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276759936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.606026:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276759936:12345-0@lo:400:kworker.0 Request processed in 110us (8523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.606035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789126908.606056:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789126908.606062:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276760448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126908.606103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276760448:12345-0@lo:400:kworker.0 Request processed in 41us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126908.606109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:3.0:1789126908.606243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126908.606386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423647d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276759936:0@lo:400:kworker.0 00000100:00100000:0.0:1789126908.606401:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276760448:0@lo:400:kworker.0 00010000:00010000:1.0:1789126909.355154:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126910.378877:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126910.636266:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126910.636299:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276761088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126910.636384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126910.637198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761088 00000100:00100000:3.0:1789126910.637210:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761088 00000100:00100000:3.0:1789126910.637280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789126910.637291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276761088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126910.637333:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126910.637411:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276761088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126910.637419:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789126910.637762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276761088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126911.146908:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276761216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126911.146984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126911.147033:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276761344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126911.147079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126911.149984:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761216 00000100:00100000:0.0:1789126911.150012:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761216 00000100:00100000:0.0:1789126911.150082:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761344 00000100:00100000:0.0:1789126911.150086:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761344 00000100:00100000:0.0:1789126911.150111:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789126911.150121:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276761216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789126911.150168:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789126911.150180:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126911.150220:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789126911.150230:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276761344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126911.150243:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126911.154604:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276761344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4367us (7514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126911.154619:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789126911.154708:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276761216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4586us (7721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126911.154717:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1789126911.154801:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99cf00 x1876035276761216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126911.154825:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276761216:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789126911.159120:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99ed00 x1876035276761344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126911.159156:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276761344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789126911.405054:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126912.171614:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126912.171639:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276761472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126912.171735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126912.174412:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761472 00000100:00100000:0.0:1789126912.174424:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761472 00000100:00100000:0.0:1789126912.174494:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789126912.174504:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276761472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789126912.174538:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789126912.175206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276761472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 700us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126912.175215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789126912.175709:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276761472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126912.336992:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126912.337037:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126912.337064:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126912.337125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126912.337208:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843904 00000100:00100000:3.0:1789126912.337218:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843904 00000100:00100000:3.0:1789126912.337290:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1789126912.337300:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126912.337388:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126912.337396:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:0.0:1789126912.337588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843520 00000100:00100000:0.0:1789126912.337592:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843520 00000100:00100000:0.0:1789126912.337633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 430 00000100:00100000:0.0:1789126912.337640:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258843520:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126912.337702:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258843520:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126912.337708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 430 00000100:00100000:0.0:1789126912.337737:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843648 00000100:00100000:0.0:1789126912.337740:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843648 00000100:00100000:0.0:1789126912.337764:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844160 00000100:00100000:0.0:1789126912.337774:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844160 00000100:00100000:0.0:1789126912.337799:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:0.0:1789126912.337806:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843648:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126912.337837:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843648:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126912.337844:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:0.0:1789126912.337856:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00100000:0.0:1789126912.337862:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258844160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126912.337905:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258844160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126912.337912:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00080000:2.0:1789126912.338343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126912.338349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126912.338352:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126912.347341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126912.347385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126912.347471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258843776 00000100:00100000:3.0:1789126912.347480:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258843776 00000100:00100000:3.0:1789126912.347541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844032 00000100:00100000:3.0:1789126912.347544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844032 00000100:00100000:3.0:1789126912.347565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 243 00000100:00100000:3.0:1789126912.347584:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126912.347678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258843776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126912.347686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 243 00000100:00100000:3.0:1789126912.347702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00100000:3.0:1789126912.347708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258844032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126912.347728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258844032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126912.347734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00080000:2.0:1789126912.347905:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126912.347909:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789126912.428034:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126913.453080:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126913.708619:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126913.708642:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276761600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126913.708745:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709051:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761600 00000100:00100000:1.0:1789126913.709059:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761600 00000100:00100000:1.0:1789126913.709125:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789126913.709145:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276761600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126913.709174:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126913.709220:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276761600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126913.709228:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789126913.709252:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276761856:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709301:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276762368:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709338:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276762880:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709379:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789126913.709385:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276761728:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709435:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709474:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276762752:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126913.709528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761856 00000100:00100000:1.0:1789126913.709533:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761856 00000100:00100000:1.0:1789126913.709557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762368 00000100:00100000:1.0:1789126913.709559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762368 00000100:00100000:1.0:1789126913.709571:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762880 00000100:00100000:1.0:1789126913.709585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762880 00000100:00100000:1.0:1789126913.709603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789126913.709609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276761856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276761856:12345-0@lo:400:kworker.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126913.709679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789126913.709691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789126913.709698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276762368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276762368:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126913.709731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789126913.709742:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789126913.709747:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276762880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276762880:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126913.709779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789126913.709798:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761728 00000100:00100000:1.0:1789126913.709801:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761728 00000100:00100000:1.0:1789126913.709821:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789126913.709827:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276761728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709854:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276761728:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126913.709859:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789126913.709895:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276761728:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709908:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276761856:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709928:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276762368:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.709936:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276762880:0@lo:400:kworker.0 00000100:00080000:3.0:1789126913.710015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126913.710020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126913.710031:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762752 00000100:00100000:3.0:1789126913.710035:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762752 00000100:00100000:3.0:1789126913.710074:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789126913.710081:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e2b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276762752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126913.710118:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e2b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276762752:12345-0@lo:400:kworker.0 Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126913.710125:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789126913.714872:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126913.714931:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236682d00 x1876035276762752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126913.714947:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276762752:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715103:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276762112:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715208:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276762624:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715243:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276763136:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715277:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789126913.715283:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276761984:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715314:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276762496:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715329:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715342:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236682580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276763008:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.715376:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762112 00000100:00100000:2.0:1789126913.715381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762112 00000100:00100000:2.0:1789126913.715412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762496 00000100:00100000:2.0:1789126913.715414:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762496 00000100:00100000:2.0:1789126913.715429:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763008 00000100:00100000:2.0:1789126913.715431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763008 00000100:00100000:2.0:1789126913.715460:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789126913.715467:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276762112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276762112:12345-0@lo:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789126913.715531:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789126913.715536:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276762496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715555:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276762496:12345-0@lo:400:kworker.0 Request processed in 20us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715560:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789126913.715569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789126913.715574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276763008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276763008:12345-0@lo:400:kworker.0 Request processed in 18us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715597:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789126913.715610:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762624 00000100:00100000:2.0:1789126913.715612:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762624 00000100:00100000:2.0:1789126913.715629:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763136 00000100:00100000:2.0:1789126913.715631:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763136 00000100:00100000:2.0:1789126913.715646:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789126913.715669:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276762624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715693:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276762624:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715698:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789126913.715707:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789126913.715711:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276763136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715740:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276763136:12345-0@lo:400:kworker.0 Request processed in 29us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715746:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789126913.715762:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276762240 00000100:00100000:2.0:1789126913.715765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276762240 00000100:00100000:2.0:1789126913.715782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276761984 00000100:00100000:2.0:1789126913.715784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276761984 00000100:00100000:2.0:1789126913.715793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789126913.715798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276762240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276762240:12345-0@lo:400:kworker.0 Request processed in 27us (6366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715830:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789126913.715840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789126913.715845:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276761984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276761984:12345-0@lo:400:kworker.0 Request processed in 21us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.715871:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1789126913.715888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789126913.715891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789126913.715893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126913.715929:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276761984:0@lo:400:kworker.0 00010000:00080000:2.0:1789126913.715939:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422f99cf00 x1876035276762496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126913.715948:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276762496:0@lo:400:kworker.0 00010000:00080000:2.0:1789126913.715955:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236682580 x1876035276763008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126913.715973:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236682580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276763008:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.715983:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276762112:0@lo:400:kworker.0 00010000:00080000:2.0:1789126913.715990:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236682940 x1876035276762624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126913.715997:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276762624:0@lo:400:kworker.0 00000100:00100000:2.0:1789126913.716004:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789126913.716008:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9941042d8f00, transno 4294967301 00000100:00100000:2.0:1789126913.716017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276763136:0@lo:400:kworker.0 00000100:00100000:0.0:1789126913.716298:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276761600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126913.716486:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789126913.716497:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126913.716503:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276763264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126913.716532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126913.716641:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763264 00000100:00100000:2.0:1789126913.716645:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763264 00000100:00100000:2.0:1789126913.716701:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789126913.716708:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e0983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276763264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789126913.716721:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126913.716765:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e0983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276763264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126913.716772:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789126913.716863:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276763264:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789126914.283487:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789126914.283587:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789126914.475398:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126915.499197:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126915.754937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126915.754957:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276763392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126915.755019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126915.755092:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763392 00000100:00100000:0.0:1789126915.755100:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763392 00000100:00100000:0.0:1789126915.755156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789126915.755163:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276763392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126915.755193:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126915.755232:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276763392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126915.755251:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789126915.755295:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276763392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126916.267168:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126916.267193:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9942366812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276763520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126916.267273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126916.267919:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763520 00000100:00100000:1.0:1789126916.267939:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763520 00000100:00100000:1.0:1789126916.268007:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789126916.268018:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276763520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126916.268047:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126916.268105:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276763520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126916.268124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789126916.268167:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9942366812c0 x1876035276763520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126916.268184:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9942366812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276763520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126916.268259:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126916.270835:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126916.276497:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236681e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276763648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126916.276571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126916.279773:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763648 00000100:00100000:1.0:1789126916.279800:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763648 00000100:00100000:1.0:1789126916.279922:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789126916.279940:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276763648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126916.279963:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126916.280040:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276763648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (3469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126916.280048:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1789126916.282074:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236681e00 x1876035276763648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126916.282099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236681e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276763648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789126916.283036:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789126916.523213:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126917.291091:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126917.291138:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276763776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126917.291837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126917.291935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763776 00000100:00100000:1.0:1789126917.291943:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763776 00000100:00100000:1.0:1789126917.292003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789126917.292114:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276763776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126917.292147:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789126917.292208:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276763776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 195us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126917.292275:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276763776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126917.293808:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789126917.454629:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126917.454739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126917.454769:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844288 00000100:00100000:3.0:1789126917.454785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126917.454785:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844288 00000100:00100000:0.0:1789126917.454926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 432 00000100:00100000:0.0:1789126917.454935:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258844288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126917.455003:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258844288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126917.455010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 432 00000100:00100000:2.0:1789126917.457310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844544 00000100:00100000:2.0:1789126917.457324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844544 00000100:00100000:2.0:1789126917.457414:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844416 00000100:00100000:2.0:1789126917.457418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844416 00000100:00080000:1.0:1789126917.457424:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789126917.457435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126917.457461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:2.0:1789126917.457477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258844544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126917.457561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258844544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 89us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126917.460069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:3.0:1789126917.460141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258844416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126917.460226:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258844416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 144us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126917.460236:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:2.0:1789126917.460756:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:3.0:1789126917.468567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126917.468613:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126917.468687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126917.468813:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844800 00000100:00100000:1.0:1789126917.468830:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844800 00000100:00100000:2.0:1789126917.468875:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844672 00000100:00100000:2.0:1789126917.468887:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844672 00000100:00100000:1.0:1789126917.468947:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258844928 00000100:00100000:2.0:1789126917.468959:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1789126917.468965:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258844928 00000100:00100000:2.0:1789126917.468975:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258844672:12345-192.168.203.23@tcp:9:kworker.0 00000100:00100000:1.0:1789126917.469013:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 253 00000020:00000080:2.0:1789126917.469016:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eac15 00000100:00100000:1.0:1789126917.469028:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258844800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126917.469145:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258844800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 121us (530us total) trans 0 rc 0/0 00000100:00080000:3.0:1789126917.469260:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126917.469266:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126917.469268:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126917.469363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:1.0:1789126917.469380:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 253 00000100:00080000:2.0:1789126917.470140:0:8906:0:(import.c:65:import_set_state_nolock()) ffff994104348000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789126917.470316:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258844928:12345-192.168.203.23@tcp:400:kworker.0 00000001:00000004:2.0:1789126917.470496:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1789126917.470621:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126917.470671:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258844928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1292us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126917.470681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:2.0:1789126917.470999:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+2:2390:x1876035258844672:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 2027us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126917.471018:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00010000:00010000:1.0:1789126917.549058:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126918.573106:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126918.827846:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276763904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126918.827916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828116:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276763904 00000100:00100000:0.0:1789126918.828125:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276763904 00000100:00080000:3.0:1789126918.828237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126918.828364:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276764032:0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.828393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828413:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126918.828425:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276763904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126918.828467:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126918.828513:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276763904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126918.828521:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126918.828543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276764288:0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.828563:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276764160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126918.828577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126918.828599:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828609:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276764800:0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.828622:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.828625:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.828640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126918.828680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828682:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276765312:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.828708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126918.828716:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.828735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828743:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764032 00000100:00100000:2.0:1789126918.828748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828749:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764032 00000100:00100000:1.0:1789126918.828757:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765184:0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.828764:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276765440:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.828782:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789126918.828788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828794:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276764032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.828825:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276763904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126918.828832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276764032:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126918.828840:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789126918.828854:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126918.828868:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764288 00000100:00100000:0.0:1789126918.828874:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764416 00000100:00100000:0.0:1789126918.828879:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764416 00000100:00100000:2.0:1789126918.828883:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764288 00000100:00100000:1.0:1789126918.828892:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789126918.828898:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276764544:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.828907:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764672 00000100:00100000:0.0:1789126918.828911:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764672 00000100:00100000:2.0:1789126918.828913:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764800 00000100:00100000:2.0:1789126918.828918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764800 00000100:00100000:1.0:1789126918.828922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126918.828936:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789126918.828937:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276765056:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.828948:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276764416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.828959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765312 00000100:00100000:2.0:1789126918.828962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765312 00000100:00100000:1.0:1789126918.828962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126918.828977:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765568:0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.828986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764928 00000100:00100000:2.0:1789126918.828988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764928 00000100:00100000:1.0:1789126918.828995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126918.829000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765440 00000100:00100000:2.0:1789126918.829002:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765440 00000100:00100000:2.0:1789126918.829013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764544 00000100:00100000:2.0:1789126918.829016:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764544 00000100:00100000:2.0:1789126918.829028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789126918.829033:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276764288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.829070:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276764288:12345-0@lo:400:kworker.0 Request processed in 37us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126918.829232:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789126918.829248:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276764800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829255:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276764032:0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829281:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276764160 00000100:00100000:3.0:1789126918.829285:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276764160 00000100:00100000:1.0:1789126918.829289:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276764800:12345-0@lo:400:kworker.0 Request processed in 48us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126918.829298:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789126918.829317:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789126918.829323:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789126918.829327:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276765312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.829358:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276765312:12345-0@lo:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126918.829363:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789126918.829375:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789126918.829390:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829402:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276764160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126918.829416:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276764416:12345-0@lo:400:kworker.0 Request processed in 469us (734us total) trans 0 rc 0/0 00002000:00000024:3.0:1789126918.829418:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126918.829432:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789126918.829433:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276764928:12345-0@lo:400:kworker.0 Request processed in 42us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126918.829441:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789126918.829463:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789126918.829465:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789126918.829471:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276764160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126918.829477:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.829479:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276765440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829495:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789126918.829516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126918.829522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126918.829524:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276764672:12345-0@lo:400:kworker.0 Request processed in 52us (789us total) trans 0 rc 0/0 00000100:00080000:3.0:1789126918.829527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126918.829535:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789126918.829541:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765184 00000100:00100000:1.0:1789126918.829542:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276765440:12345-0@lo:400:kworker.0 Request processed in 67us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126918.829546:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765184 00000100:00100000:1.0:1789126918.829553:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789126918.829573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.829575:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789126918.829582:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765056 00000100:00100000:3.0:1789126918.829587:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765056 00000100:00100000:1.0:1789126918.829588:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.829594:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276765312:0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829610:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765568 00000100:00100000:0.0:1789126918.829612:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276764288:0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829615:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765568 00000100:00100000:1.0:1789126918.829626:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276764544:12345-0@lo:400:kworker.0 Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126918.829635:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789126918.829640:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126918.829679:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829714:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765184:12345-0@lo:400:kworker.0 Request processed in 67us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126918.829721:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789126918.829732:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789126918.829737:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829761:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276765056:12345-0@lo:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126918.829767:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789126918.829778:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789126918.829785:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126918.829813:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765568:12345-0@lo:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126918.829821:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789126918.829839:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276764544:0@lo:400:kworker.0 00010000:00080000:0.0:1789126918.829853:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e79a40 x1876035276765056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126918.829864:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276765056:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.829876:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765568:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.829888:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276764672:0@lo:400:kworker.0 00000100:00100000:1.0:1789126918.829904:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276764416:0@lo:400:kworker.0 00010000:00080000:0.0:1789126918.829906:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e792c0 x1876035276765184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126918.829919:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765184:0@lo:400:kworker.0 00010000:00080000:1.0:1789126918.829923:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e7ad00 x1876035276764928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126918.829933:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276764928:0@lo:400:kworker.0 00000100:00100000:0.0:1789126918.829943:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276764160:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789126918.829951:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa821c0 x1876035276765440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126918.829961:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276765440:0@lo:400:kworker.0 00000100:00100000:2.0:1789126918.830211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:2.0:1789126918.830236:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789126919.595021:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126920.618982:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126920.874918:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126920.874993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126920.875167:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765696 00000100:00100000:0.0:1789126920.875175:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765696 00000100:00100000:0.0:1789126920.875379:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789126920.875391:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423647f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126920.875445:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126920.875597:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423647f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276765696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126920.875607:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789126920.875704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276765696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126921.386941:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276765824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126921.387011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126921.387114:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765824 00000100:00100000:2.0:1789126921.387122:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765824 00000100:00100000:2.0:1789126921.387261:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789126921.387285:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276765824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126921.387312:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789126921.387350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126921.387364:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276765824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126921.387373:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1789126921.387385:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236681680 x1876035276765824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126921.387405:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276765824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126921.388667:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276765952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126921.388728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126921.388851:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276765952 00000100:00100000:2.0:1789126921.388857:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276765952 00000100:00100000:2.0:1789126921.388918:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789126921.388926:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276765952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126921.388943:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126921.388983:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276765952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126921.388990:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789126921.389142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789126921.389169:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236682940 x1876035276765952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126921.389185:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276765952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789126921.642908:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126922.411007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236682580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126922.411099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126922.411164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766080 00000100:00100000:2.0:1789126922.411181:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766080 00000100:00100000:2.0:1789126922.411241:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789126922.411254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276766080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126922.411298:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789126922.411369:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276766080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126922.411379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789126922.411405:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236682580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126922.576125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126922.576177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126922.576206:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126922.576229:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126922.576257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845184 00000100:00100000:3.0:1789126922.576266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845184 00000100:00100000:3.0:1789126922.576322:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845312 00000100:00100000:3.0:1789126922.576325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845312 00000100:00100000:3.0:1789126922.576338:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845440 00000100:00100000:3.0:1789126922.576340:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845440 00000100:00100000:3.0:1789126922.576357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 261 00000100:00100000:3.0:1789126922.576366:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258845184:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126922.576435:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258845184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126922.576443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 261 00000100:00100000:3.0:1789126922.576461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 262 00000100:00100000:3.0:1789126922.576468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258845312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126922.576492:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258845312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126922.576498:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 262 00000100:00100000:3.0:1789126922.576510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 263 00000100:00100000:3.0:1789126922.576517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258845440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126922.576541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258845440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126922.576547:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 263 00000100:00080000:3.0:1789126922.576566:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126922.576570:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126922.576904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845056 00000100:00100000:1.0:1789126922.576909:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845056 00000100:00100000:1.0:1789126922.576939:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 434 00000100:00100000:1.0:1789126922.576947:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258845056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126922.576981:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258845056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126922.576988:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 434 00000100:00100000:2.0:1789126922.579119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126922.579199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845568 00000100:00100000:0.0:1789126922.579206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845568 00000100:00100000:0.0:1789126922.579308:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 264 00000100:00100000:0.0:1789126922.579318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258845568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126922.579384:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258845568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126922.579391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 264 00000100:00080000:1.0:1789126922.579493:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789126922.670162:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789126922.925145:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:2.0:1789126922.925152:0:9505:0:(genops.c:885:class_export_put()) final put ffff99410434d000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:3.0:1789126922.927390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99410434d000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-OST0001 00000020:00000080:3.0:1789126922.931661:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994104348000 for lustre-OST0001 00010000:00010000:0.0:1789126923.695153:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126923.946855:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276766208:0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.946933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126923.946950:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276766592:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.946992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126923.947002:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276766720:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947021:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276767104:0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.947035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126923.947070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126923.947106:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.947107:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126923.947132:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276767744:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126923.947170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126923.947196:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766592 00000100:00100000:0.0:1789126923.947204:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766592 00000100:00100000:2.0:1789126923.947227:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276766336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126923.947252:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789126923.947257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126923.947265:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276766592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947322:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276766592:12345-0@lo:400:kworker.0 Request processed in 61us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126923.947329:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789126923.947350:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766720 00000100:00100000:0.0:1789126923.947354:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766720 00000100:00100000:0.0:1789126923.947379:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767104 00000100:00100000:0.0:1789126923.947383:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767104 00000100:00100000:0.0:1789126923.947406:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767616 00000100:00100000:0.0:1789126923.947408:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767616 00000100:00100000:0.0:1789126923.947425:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789126923.947433:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276766720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.947456:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276766848:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947481:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276766720:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126923.947493:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789126923.947496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126923.947512:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789126923.947519:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276767104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.947548:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276767104:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126923.947554:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789126923.947567:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767232 00000100:00100000:0.0:1789126923.947571:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789126923.947574:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767232 00000100:00100000:0.0:1789126923.947589:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.947606:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767744 00000100:00100000:3.0:1789126923.947610:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767744 00000100:00100000:0.0:1789126923.947626:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276767616:12345-0@lo:400:kworker.0 Request processed in 39us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126923.947634:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789126923.947638:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126923.947719:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276767232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.947765:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276767232:12345-0@lo:400:kworker.0 Request processed in 120us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.947774:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789126923.947793:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126923.947800:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276767744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948049:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276767744:12345-0@lo:400:kworker.0 Request processed in 249us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.948056:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789126923.948092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766208 00000100:00100000:3.0:1789126923.948096:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766208 00000100:00100000:3.0:1789126923.948124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789126923.948131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276766208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948161:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276766208:12345-0@lo:400:kworker.0 Request processed in 30us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.948167:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789126923.948193:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276766464:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126923.948241:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276766976:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126923.948291:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276767488:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126923.948401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766464 00000100:00100000:3.0:1789126923.948405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766464 00000100:00100000:3.0:1789126923.948422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766976 00000100:00100000:3.0:1789126923.948424:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766976 00000100:00100000:3.0:1789126923.948439:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767488 00000100:00100000:3.0:1789126923.948441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767488 00000100:00100000:3.0:1789126923.948455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789126923.948463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236682940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948500:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236682940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276766464:12345-0@lo:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.948507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789126923.948522:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789126923.948528:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276766976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948559:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276766976:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.948565:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789126923.948579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789126923.948586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276767488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276767488:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.948618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789126923.948735:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276766464:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948748:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276766976:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.948766:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.949972:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276767360:0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.950017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126923.950040:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276767872:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.950050:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766336 00000100:00100000:3.0:1789126923.950068:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766336 00000100:00100000:3.0:1789126923.950111:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789126923.950121:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276766336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126923.950147:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126923.950426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126923.950442:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276766336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 322us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.950451:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789126923.950481:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f9e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276766336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126923.950497:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276766720:0@lo:400:kworker.0 00010000:00080000:3.0:1789126923.950515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80b40 x1876035276767232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126923.950524:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276767232:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.950537:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276767744:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.950545:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276766208:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.950589:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767360 00000100:00100000:3.0:1789126923.950593:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767360 00000100:00100000:3.0:1789126923.950620:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276767872 00000100:00100000:3.0:1789126923.950623:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276767872 00000100:00100000:3.0:1789126923.950641:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789126923.951708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126923.951715:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126923.951717:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126923.951719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126923.951819:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276766848 00000100:00100000:2.0:1789126923.951826:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276766848 00000100:00100000:2.0:1789126923.951863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789126923.951872:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276766848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126923.952287:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276766592:0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.952308:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789126923.952369:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126923.952793:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276767872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126923.953054:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276766848:12345-0@lo:400:kworker.0 Request processed in 1181us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126923.953072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789126923.953205:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276766848:0@lo:400:kworker.0 00010000:00080000:1.0:1789126923.953320:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa821c0 x1876035276767104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126923.953334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276767104:0@lo:400:kworker.0 00010000:00080000:1.0:1789126923.953350:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e792c0 x1876035276767616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126923.953360:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276767616:0@lo:400:kworker.0 00000100:00100000:3.0:1789126923.954088:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276767360:12345-0@lo:400:kworker.0 Request processed in 3438us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126923.954097:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789126923.954134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236636d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126923.954172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789126923.954237:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80780 x1876035276767360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126923.954246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768000 00000100:00100000:1.0:1789126923.954253:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768000 00000100:00100000:2.0:1789126923.954260:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276767360:0@lo:400:kworker.0 00000100:00100000:1.0:1789126923.954305:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789126923.954315:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276768000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126923.954334:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126923.954385:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276768000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126923.954392:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789126923.954409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236636d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126923.956348:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276767872:12345-0@lo:400:kworker.0 Request processed in 3555us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126923.956360:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789126923.956393:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276767872:0@lo:400:kworker.0 00000040:00080000:3.0:1789126924.524790:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789126924.526140:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789126924.720459:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126925.738958:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126925.994998:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126925.995031:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276768128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126925.995107:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126925.995347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768128 00000100:00100000:0.0:1789126925.995354:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768128 00000100:00100000:0.0:1789126925.995407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789126925.995415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276768128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126925.995446:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126925.995499:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276768128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126925.995506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789126925.997276:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276768128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126926.507242:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126926.507313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126926.507445:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768256 00000100:00100000:3.0:1789126926.507460:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768256 00000100:00080000:1.0:1789126926.507552:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126926.507616:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789126926.507627:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276768256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126926.507690:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126926.507739:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276768256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126926.507747:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1789126926.507821:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994102e79a40 x1876035276768256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126926.507838:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126926.512210:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276768384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126926.512293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126926.512386:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768384 00000100:00100000:3.0:1789126926.512393:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768384 00000100:00100000:3.0:1789126926.512448:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789126926.512470:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276768384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126926.512492:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789126926.512561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126926.514006:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276768384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1524us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126926.514019:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789126926.514184:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236637480 x1876035276768384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789126942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126926.514206:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276768384:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789126926.640642:0:14744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:42:05 (1789126925) 00010000:00010000:2.0:1789126926.767580:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126927.531637:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276768512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126927.531809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126927.532030:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768512 00000100:00100000:2.0:1789126927.532049:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768512 00000100:00100000:2.0:1789126927.532103:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789126927.532113:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276768512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126927.532145:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789126927.532199:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276768512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126927.532207:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789126927.532251:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276768512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126927.700738:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126927.700776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126927.700808:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126927.700832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126927.700853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126927.700876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845952 00000100:00100000:1.0:1789126927.700884:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845952 00000100:00100000:1.0:1789126927.700944:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846208 00000100:00100000:1.0:1789126927.700947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846208 00000100:00100000:1.0:1789126927.700958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845824 00000100:00100000:1.0:1789126927.700960:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845824 00000100:00100000:1.0:1789126927.700969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846080 00000100:00100000:1.0:1789126927.700971:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846080 00000100:00100000:1.0:1789126927.700985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 271 00000100:00100000:1.0:1789126927.700993:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258845952:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126927.701115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 272 00000100:00100000:2.0:1789126927.701125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258846208:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126927.701186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258846208:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126927.701195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 272 00000100:00100000:2.0:1789126927.701214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 273 00000100:00100000:2.0:1789126927.701220:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258845824:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126927.701249:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258845824:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126927.701255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 273 00000100:00100000:2.0:1789126927.701267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 274 00000100:00100000:2.0:1789126927.701273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258846080:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126927.701304:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258846080:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126927.701310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 274 00000100:00080000:2.0:1789126927.701470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126927.701474:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126927.701644:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258845952:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 651us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126927.701678:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 271 00000100:00100000:3.0:1789126927.703430:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258845696 00000100:00100000:3.0:1789126927.703456:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258845696 00000100:00100000:3.0:1789126927.704139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 436 00000100:00100000:3.0:1789126927.704151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258845696:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126927.704222:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258845696:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 73us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126927.704230:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 436 00010000:00010000:0.0:1789126927.789682:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126927.987910:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126927.988006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846336 00000100:00100000:3.0:1789126927.988023:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846336 00000100:00100000:3.0:1789126927.988169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789126927.988182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:11326:x1876035258846336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126927.988209:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126927.988249:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eacf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c385 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988337:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988354:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988380:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126927.988452:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126927.988457:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126927.988510:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988547:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eacf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c385 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988604:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c385 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126927.988614:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648fa00) 00010000:00010000:3.0:1789126927.988617:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126927.988621:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:3.0:1789126927.988789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:11326:x1876035258846336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 610us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126927.988798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:1.0:1789126928.001058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126928.001269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846464 00000100:00100000:2.0:1789126928.001281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846464 00000100:00100000:2.0:1789126928.001422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789126928.001435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:11327:x1876035258846464:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126928.001463:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126928.001489:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666ead03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c38c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001583:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001601:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001615:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001633:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001639:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001706:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001817:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126928.001828:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126928.004083:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126928.004096:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126928.004140:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004168:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004176:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004183:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126928.004189:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004199:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004237:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648fa00) 00010000:00010000:3.0:1789126928.004242:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126928.004249:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004278:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004284:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004291:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004296:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126928.004299:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004305:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004313:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994103eaae00) 00010000:00010000:3.0:1789126928.004316:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126928.004319:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004324:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666ead11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004391:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666ead03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c38c expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004406:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c38c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.004415:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103eaaf00) 00010000:00010000:3.0:1789126928.004417:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126928.004419:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3c00, rc 0) 00000100:00100000:3.0:1789126928.004523:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11327:x1876035258846464:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3090us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126928.004534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1789126928.008192:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126928.011294:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846592 00000100:00100000:1.0:1789126928.011314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846592 00000100:00100000:1.0:1789126928.011423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1789126928.011436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11327:x1876035258846592:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789126928.011556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11327:x1876035258846592:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 121us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126928.011565:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789126928.014642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126928.015728:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846848 00000100:00100000:3.0:1789126928.015746:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846848 00000100:00100000:3.0:1789126928.015838:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1789126928.015852:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11327:x1876035258846848:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126928.015883:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126928.015912:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c393 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016016:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016046:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016061:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016291:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016324:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016337:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016479:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f000/0xa840b4da666ead34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016486:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f000/0xa840b4da666ead34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016493:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f000/0xa840b4da666ead34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126928.016504:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789126928.016593:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016600:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016607:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016625:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126928.016630:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016837:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016849:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103eaaf00) 00010000:00010000:3.0:1789126928.016852:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126928.016856:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016862:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016875:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016881:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016886:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016890:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126928.016892:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016897:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016903:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99423648f700) 00010000:00010000:3.0:1789126928.016905:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126928.016907:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.016920:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.017946:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c393 expref: 10 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.017965:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f000/0xa840b4da666ead34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c393 expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126928.017973:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:3.0:1789126928.017975:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126928.017978:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f000, rc 0) 00000100:00100000:3.0:1789126928.018053:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11327:x1876035258846848:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2205us (3426us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789126928.018063:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1789126928.026544:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126928.033357:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258846976 00000100:00100000:3.0:1789126928.033373:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258846976 00000100:00100000:2.0:1789126928.033688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:2.0:1789126928.033703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11327:x1876035258846976:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789126928.033889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11327:x1876035258846976:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 178us (8267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126928.033898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1789126928.037778:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126928.037995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258847104 00000100:00100000:2.0:1789126928.038008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258847104 00000100:00100000:2.0:1789126928.038101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1789126928.038114:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:11327:x1876035258847104:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789126928.046810:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8480us 00000100:00100000:3.0:1789126928.069575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:11327:x1876035258847104:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 31451us (31797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126928.069594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000040:00080000:3.0:1789126928.620303:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789126928.624562:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789126928.811126:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126929.068554:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789126929.068684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126929.068912:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126929.068928:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276768896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126929.068966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126929.069033:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768896 00000100:00100000:2.0:1789126929.069042:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768896 00000100:00100000:2.0:1789126929.069108:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789126929.069119:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276768896:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126929.069305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768640 00000100:00100000:0.0:1789126929.069311:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768640 00000100:00100000:0.0:1789126929.069343:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789126929.069350:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276768640:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789126929.069440:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126929.069483:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276768896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 366us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126929.069493:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789126929.069519:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126929.069558:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276768896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126929.069772:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276768768:0@lo:400:kworker.0 00000100:00100000:2.0:1789126929.069807:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126929.069874:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276768768 00000100:00100000:2.0:1789126929.069878:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276768768 00000100:00100000:2.0:1789126929.069913:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789126929.069921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276768768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126929.069960:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276768768:12345-0@lo:400:kworker.0 Request processed in 40us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126929.069966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789126929.069983:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126929.070009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126929.070057:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276768768:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073127:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769024 00000100:00100000:3.0:1789126929.073164:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769024 00000100:00100000:3.0:1789126929.073248:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789126929.073260:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126929.073299:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126929.073402:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.073410:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1789126929.073435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126929.073488:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126929.073551:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126929.073564:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276769152:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073606:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.073641:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769152 00000100:00100000:3.0:1789126929.073645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769152 00000100:00100000:3.0:1789126929.073697:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789126929.073705:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276769152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276769152:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.073755:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789126929.073783:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276769152:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073816:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276769280:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073844:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.073873:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769280 00000100:00100000:3.0:1789126929.073877:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769280 00000100:00100000:3.0:1789126929.073904:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789126929.073912:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276769280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.073947:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276769280:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.073964:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789126929.073995:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276769280:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074037:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126929.074043:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769408:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074114:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276769536:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769536 00000100:00100000:3.0:1789126929.074168:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769536 00000100:00100000:3.0:1789126929.074196:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789126929.074203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276769536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074238:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276769536:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.074244:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1789126929.074259:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126929.074277:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276769536:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074307:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126929.074314:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276769664:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074360:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769664 00000100:00100000:3.0:1789126929.074364:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769664 00000100:00100000:3.0:1789126929.074390:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789126929.074397:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276769664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074428:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276769664:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.074444:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1789126929.074460:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789126929.074480:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee12c0 x1876035276769664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126929.074491:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276769664:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074521:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276769792:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074575:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769792 00000100:00100000:3.0:1789126929.074579:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769792 00000100:00100000:3.0:1789126929.074609:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789126929.074616:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276769792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074669:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276769792:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.074675:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789126929.074692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789126929.074707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa4d680 x1876035276769792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126929.074716:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276769792:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074743:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126929.074748:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769920:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074792:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769920 00000100:00100000:3.0:1789126929.074796:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769920 00000100:00100000:3.0:1789126929.074826:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789126929.074832:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074871:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769920:12345-0@lo:400:kworker.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.074877:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789126929.074890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789126929.074904:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa4d680 x1876035276769920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789126945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126929.074913:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769920:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074939:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276770048:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.074962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.074983:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276770048 00000100:00100000:3.0:1789126929.074986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276770048 00000100:00100000:3.0:1789126929.075011:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789126929.075017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276770048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.075067:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276770048:12345-0@lo:400:kworker.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.075073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1789126929.075089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126929.075102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276770048:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.075127:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126929.075133:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276770176:0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.075154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126929.075172:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276770176 00000100:00100000:3.0:1789126929.075175:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276770176 00000100:00100000:3.0:1789126929.075201:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789126929.075207:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276770176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126929.075247:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276770176:12345-0@lo:400:kworker.0 Request processed in 41us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126929.075253:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1789126929.075268:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789126929.075281:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa4d680 x1876035276770176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126929.075290:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276770176:0@lo:400:kworker.0 00000100:00100000:0.0:1789126929.078135:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276768640:12345-0@lo:400:kworker.0 Request processed in 8768us (9435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126929.078269:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789126929.078477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276769408 00000100:00100000:0.0:1789126929.078486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276769408 00000100:00100000:0.0:1789126929.078552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789126929.078562:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126929.078684:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276769408:12345-0@lo:400:kworker.0 Request processed in 123us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126929.078692:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789126929.078744:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276769408:0@lo:400:kworker.0 00000100:00100000:1.0:1789126929.081340:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994102e783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276768640:0@lo:400:kworker.0 00010000:00010000:3.0:1789126929.851417:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126929.986007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126929.991530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258847232 00000100:00100000:3.0:1789126929.991542:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258847232 00000100:00100000:3.0:1789126929.991624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1789126929.991635:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11369:x1876035258847232:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126929.991674:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126929.991694:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c39a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991750:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991763:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991774:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991786:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991793:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991807:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.991850:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789126929.992313:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789126929.992942:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.992950:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.992956:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148fa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126929.992961:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.992970:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.992983:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648fa00) 00010000:00010000:3.0:1789126929.992986:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126929.992992:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.992998:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993010:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993025:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993037:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993042:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126929.993045:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993051:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993058:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994236490b00) 00010000:00010000:3.0:1789126929.993061:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126929.993064:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993069:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993105:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c39a expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993115:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648fa00) 00010000:00010000:3.0:1789126929.993117:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126929.993120:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c39a expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126929.993129:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126929.993192:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11369:x1876035258847232:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1559us (7194us total) trans 0 rc 301/301 00000100:00100000:3.0:1789126929.993208:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1789126930.004311:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.004346:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258847488 00000100:00100000:3.0:1789126930.004355:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258847488 00000100:00100000:3.0:1789126930.004409:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1789126930.004419:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11369:x1876035258847488:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1789126930.004473:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126930.004499:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eacfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c385 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004518:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99423648fa00) 00010000:00010000:3.0:1789126930.004530:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126930.004589:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004603:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004613:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004625:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004633:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.004639:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013713:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013739:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013751:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126930.013770:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000126b220e reply state 00000000f5f5a2ff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013780:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013788:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126930.013791:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126930.013795:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789126930.013800:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789126930.013809:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013816:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013823:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013829:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.013835:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013969:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013981:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236490e00) 00010000:00010000:3.0:1789126930.013984:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.013988:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.013994:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead57 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126930.014014:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000126b220e reply state 00000000f5f5a2ff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.014033:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.014040:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994236490800) 00010000:00010000:3.0:1789126930.014042:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126930.014044:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789126930.014159:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:11369:x1876035258847488:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 9737us (9854us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789126930.014170:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1789126930.116472:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.116583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258847616 00000100:00100000:0.0:1789126930.116601:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258847616 00000100:00100000:0.0:1789126930.116740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1789126930.116751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:11377:x1876035258847616:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:0.0:1789126930.116775:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126930.116823:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ead6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117439:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117456:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117467:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126930.117521:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789126930.117525:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126930.117564:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117590:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ead6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117609:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a1 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.117617:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:2.0:1789126930.117620:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126930.117623:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2200, rc 0) 00000100:00100000:2.0:1789126930.117740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:11377:x1876035258847616:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 990us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126930.117751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1789126930.177977:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.178483:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258847744 00000100:00100000:3.0:1789126930.178497:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258847744 00000100:00100000:3.0:1789126930.178637:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1789126930.178696:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:11383:x1876035258847744:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126930.178725:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.178772:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ead7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3a8 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178873:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178891:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178905:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178919:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178927:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.178935:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179105:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179115:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179122:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.179177:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789126930.179182:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126930.179304:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179328:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179335:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179343:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179350:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.179356:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179364:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179379:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:3.0:1789126930.179383:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.179389:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179396:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666ead81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179414:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179421:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179427:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179439:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.179443:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179449:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179458:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994236490800) 00010000:00010000:3.0:1789126930.179461:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.179464:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179471:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666ead88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179506:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ead7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a8 expref: 13 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179522:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a8 expref: 12 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.179530:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126930.179533:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789126930.179535:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ea00, rc 0) 00000100:00100000:3.0:1789126930.179626:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:11383:x1876035258847744:12345-192.168.203.23@tcp:101:bash.0 Request processed in 979us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.179635:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1789126930.182705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.182808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848000 00000100:00100000:3.0:1789126930.182837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848000 00000100:00100000:3.0:1789126930.182919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1789126930.182932:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:11383:x1876035258848000:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126930.182958:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.182984:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3af expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183158:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183176:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183200:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183358:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183382:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.183395:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789126930.185188:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789126930.185352:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185367:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185388:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185425:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185432:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185439:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185444:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.185449:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185457:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185469:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126930.185471:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.185475:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185481:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666ead9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126930.185493:0:6512:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008b41355e reply state 00000000effae6f0 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185503:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185517:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:3.0:1789126930.185519:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126930.185522:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789126930.185561:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666ead96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185576:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.185583:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:3.0:1789126930.185585:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126930.185587:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216dc00, rc 0) 00000100:00100000:3.0:1789126930.185739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:11383:x1876035258848000:12345-192.168.203.23@tcp:101:bash.0 Request processed in 2809us (3048us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789126930.185749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1789126930.204405:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.205012:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848128 00000100:00100000:3.0:1789126930.205468:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848128 00000100:00100000:2.0:1789126930.205670:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1789126930.205680:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258848128:12345-192.168.203.23@tcp:8:bash.0 00010000:00080000:2.0:1789126930.205711:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:2.0:1789126930.205744:0:8428:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666eadb9 00002000:00100000:2.0:1789126930.205757:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7cbe914d-2346-44a4-9fd5-22d31c7628a2/ffff99422035d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789126930.205951:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789126930.206201:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789126930.206560:0:8428:0:(import.c:65:import_set_state_nolock()) ffff994220359800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126930.206716:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258848128:12345-192.168.203.23@tcp:8:bash.0 Request processed in 1035us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126930.206726:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1789126930.210257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.210375:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848256 00000100:00100000:3.0:1789126930.210384:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848256 00000100:00100000:3.0:1789126930.210502:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789126930.210512:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:0:x1876035258848256:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126930.210530:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.210550:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3b6 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126930.210573:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789126930.210590:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1789126930.210609:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126930.210619:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.210641:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.210692:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d600, rc 0) 00000100:00100000:3.0:1789126930.210741:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:0:x1876035258848256:12345-192.168.203.23@tcp:101:bash.0 Request processed in 230us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.210747:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00080000:0.0:1789126930.210799:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126930.224418:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.224587:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848384 00000100:00100000:3.0:1789126930.224596:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848384 00000100:00100000:3.0:1789126930.224841:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1789126930.224853:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11383:x1876035258848384:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126930.224869:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.224887:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3bd expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.224918:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.224927:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126930.224931:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126930.224936:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.224984:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.224999:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126930.225012:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104304b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276770304:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126930.225145:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942138d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126930.230070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.230722:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104304b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276770304:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126930.230762:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.230783:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d000, rc 0) 00000100:00100000:3.0:1789126930.230857:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:11383:x1876035258848384:12345-192.168.203.23@tcp:101:bash.0 Request processed in 6006us (6447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.230865:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1789126930.231317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848512 00000100:00100000:0.0:1789126930.231359:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848512 00010000:00010000:0.0:1789126930.231390:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126930.231409:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1789126930.231415:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258848512:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126930.231425:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126930.231440:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.231449:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.231842:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e90dda/0xa840b4da666eadc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3b6 expref: 8 pid: 8906 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.231860:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126930.231865:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126930.231886:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.231957:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.231998:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126930.232011:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876035276770432:192.168.203.23@tcp:105: 00000100:00100000:0.0:1789126930.232141:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126930.235065:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041030c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876035276770432:192.168.203.23@tcp:105: 00010000:00010000:0.0:1789126930.235091:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126930.235234:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258848512:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3816us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126930.235246:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:2.0:1789126930.238755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.238943:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258848768 00000100:00100000:0.0:1789126930.238951:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258848768 00000100:00100000:0.0:1789126930.239004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789126930.239024:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:11383:x1876035258848768:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:0.0:1789126930.239301:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11383:x1876035258848768:12345-192.168.203.23@tcp:35:bash.0 Request processed in 287us (553us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789126930.239309:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1789126930.355229:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.355581:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258849024 00000100:00100000:0.0:1789126930.355596:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258849024 00000100:00100000:0.0:1789126930.355705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:0.0:1789126930.355734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11393:x1876035258849024:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126930.355767:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126930.355795:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eadce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126930.355952:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789126930.356088:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eadce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3c4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.356105:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:0.0:1789126930.356108:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789126930.356115:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eadce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3c4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.356133:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364caa00, rc 0) 00000100:00100000:0.0:1789126930.356212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:11393:x1876035258849024:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 481us (998us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1789126930.356219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:1.0:1789126930.362135:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.363124:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258849280 00000100:00100000:0.0:1789126930.363140:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258849280 00000100:00100000:0.0:1789126930.363217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789126930.363231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:11393:x1876035258849280:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789126930.363522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:11393:x1876035258849280:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 293us (1411us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789126930.363531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789126930.428374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.428489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258849408 00000100:00100000:3.0:1789126930.428498:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258849408 00000100:00100000:3.0:1789126930.428568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1789126930.428579:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:11399:x1876035258849408:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126930.428601:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.428620:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.428890:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.428906:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.428918:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.429291:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789126930.429296:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126930.429322:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.429351:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3cb expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.429372:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3cb expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.429381:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126930.429384:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126930.429387:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216ca00, rc 0) 00000100:00100000:3.0:1789126930.429455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11399:x1876035258849408:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 879us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.429462:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1789126930.436507:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.436685:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258849664 00000100:00100000:3.0:1789126930.436697:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258849664 00000100:00100000:3.0:1789126930.436845:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1789126930.436858:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11399:x1876035258849664:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126930.436895:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.436921:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eadea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3d2 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.437075:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eadf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.437092:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eadf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.437106:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eadf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.437119:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789126930.437271:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eadea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d2 expref: 22 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.437297:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eadf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d2 expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.437307:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:3.0:1789126930.437310:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126930.437315:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d600, rc 0) 00000100:00100000:3.0:1789126930.437393:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:11399:x1876035258849664:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 538us (900us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789126930.437403:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1789126930.441148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126930.441202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.441279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850048 00000100:00100000:3.0:1789126930.441309:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850048 00000100:00100000:3.0:1789126930.441381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1789126930.441393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:11399:x1876035258850048:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126930.441424:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.441455:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eadff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.441789:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.441808:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.441823:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.441838:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789126930.442051:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eadff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d9 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.442073:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.442083:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:3.0:1789126930.442086:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789126930.442090:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126930.442205:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:11399:x1876035258850048:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 814us (1002us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789126930.442215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1789126930.442301:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258849792 00000100:00100000:0.0:1789126930.442318:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258849792 00000100:00100000:0.0:1789126930.442367:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1789126930.442376:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:2392:x1876035258849792:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126930.442388:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126930.442405:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eadf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d2 expref: 23 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.442418:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:0.0:1789126930.442422:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126930.442443:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:2392:x1876035258849792:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 69us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126930.442450:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1789126930.454415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126930.454995:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850176 00000100:00100000:1.0:1789126930.455010:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850176 00000100:00100000:1.0:1789126930.455143:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1789126930.455156:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258850176:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:1.0:1789126930.455217:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.455242:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.455252:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126930.455257:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126930.455262:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.455307:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.455325:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 7 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126930.455343:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276770560:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126930.455466:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126930.462154:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276770560:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126930.462192:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126930.465448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126930.465753:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850304 00000100:00100000:1.0:1789126930.465770:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850304 00002000:00100000:1.0:1789126930.465855:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9941030dd680 x1876035258850304/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:421/0 lens 504/0 e 0 to 0 dl 1789126941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126930.465867:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941030dd680 with x1876035258850304 ext(0->12) 00010000:00010000:1.0:1789126930.465879:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 8 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.465910:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 8 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789126930.465920:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9941030dd680 00000100:00100000:1.0:1789126930.465957:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789126930.465968:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258850304:12345-192.168.203.23@tcp:4:lfs.0 00000001:00100000:3.0:1789126930.469681:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000100:00100000:1.0:1789126930.471068:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2393:x1876035258850304:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 5093us (5620us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789126930.471082:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:1.0:1789126930.471094:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9941030dd680 x1876035258850304/t4294967300(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:421/0 lens 504/448 e 0 to 0 dl 1789126941 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126930.471104:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941030dd680 with x1876035258850304 ext(0->12) 00010000:00010000:1.0:1789126930.471115:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.471133:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789126930.471254:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9941030dd680 00000100:00100000:1.0:1789126930.475308:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.475388:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850432 00000100:00100000:0.0:1789126930.475406:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850432 00010000:00010000:0.0:1789126930.475470:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126930.475532:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:0.0:1789126930.475546:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2393:x1876035258850432:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126930.475567:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789126930.475590:0:7920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789126930.475594:0:7920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789126929 00002000:00010000:0.0:1789126930.475596:0:7920:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789126930 00002000:00010000:0.0:1789126930.475600:0:7920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789126929 00002000:00010000:0.0:1789126930.475602:0:7920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789126930.475610:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.475676:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.475705:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000126b4295/0xa840b4da666eadc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3bd expref: 9 pid: 8429 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.475727:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126930.475733:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126930.475739:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.475750:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.475793:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126930.475866:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258850432:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 324us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126930.475876:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00010000:00010000:3.0:1789126930.476588:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476602:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476630:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476639:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476894:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476904:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126930.476909:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476920:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476958:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.476966:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020301ca6/0xa840b4da666eae14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126930.477073:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258850176:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 21917us (22669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.477082:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1789126930.482231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126930.482606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850688 00000100:00100000:2.0:1789126930.482616:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850688 00000100:00100000:2.0:1789126930.482705:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789126930.482717:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11399:x1876035258850688:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:2.0:1789126930.482783:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d9 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789126930.483502:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789126930.483550:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789126930.484579:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789126930.484629:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.484678:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.484688:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.484726:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.484764:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 26 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126930.484778:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276770688:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126930.485495:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef780 going to sleep for 11 seconds 00000100:00100000:0.0:1789126930.490751:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276770688:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126930.490797:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126930.491151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126930.491362:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850816 00000100:00100000:2.0:1789126930.491377:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850816 00010000:00010000:2.0:1789126930.491421:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 27 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126930.491463:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:2.0:1789126930.491477:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:2394:x1876035258850816:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126930.491492:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126930.491499:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 27 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491511:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 27 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491534:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eadab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3af expref: 27 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491552:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:2.0:1789126930.491557:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491583:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491591:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126930.491627:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126930.491677:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.491689:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126930.491745:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:2394:x1876035258850816:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 270us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126930.491753:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000001:00080000:1.0:1789126930.492191:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789126930.492355:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789126930.492476:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236624f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276770816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126930.492725:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126930.492775:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126930.492799:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276770816 00000100:00100000:2.0:1789126930.492808:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276770816 00000100:00100000:2.0:1789126930.493091:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789126930.493101:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276770816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789126930.493228:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276770816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126930.493236:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789126930.493330:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236624f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276770816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789126930.493540:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789126930.493607:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236624f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276770944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126930.493644:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126930.493712:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789126930.493846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276770944 00000100:00100000:2.0:1789126930.493864:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276770944 00000100:00100000:2.0:1789126930.493890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789126930.493897:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276770944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789126930.493997:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876035276770944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (353us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789126930.494004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789126930.494302:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236624f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276770944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789126930.494345:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789126930.494374:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494384:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494393:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494411:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126930.494416:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494425:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494440:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:1.0:1789126930.494444:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789126930.494448:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126930.494454:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eae1b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789126930.494624:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789126930.494727:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789126930.494738:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355699089190ns, next at 356699087291ns, rc = 0 00000001:00080000:1.0:1789126930.494745:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789126930.494766:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490b00) 00010000:00010000:1.0:1789126930.494769:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789126930.494776:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3d9 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126930.494885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:11399:x1876035258850688:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 12171us (12663us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789126930.494897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000020:00080000:1.0:1789126930.494901:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789126930.497597:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.497694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258850944 00000100:00100000:0.0:1789126930.497703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258850944 00000100:00100000:0.0:1789126930.497798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1789126930.497809:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:11399:x1876035258850944:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126930.497842:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126930.497877:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eae22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.497931:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eae22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3e0 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.497947:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eae22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3e0 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.497964:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126930.497969:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789126930.497972:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb800, rc 0) 00000100:00100000:0.0:1789126930.498034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11399:x1876035258850944:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 227us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126930.498041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:2.0:1789126930.502296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.503028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258851200 00000100:00100000:3.0:1789126930.503039:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258851200 00000100:00100000:3.0:1789126930.503092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789126930.503102:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212266050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11399:x1876035258851200:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126930.503402:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212266050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+31:11399:x1876035258851200:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 301us (1116us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789126930.503411:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1789126930.585318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.585407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258851456 00000100:00100000:3.0:1789126930.585416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258851456 00000100:00100000:3.0:1789126930.585476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1789126930.585486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+31:11409:x1876035258851456:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126930.585511:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.585531:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3e7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.585622:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789126930.585781:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3e7 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.585795:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:3.0:1789126930.585798:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126930.585803:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3e7 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.585817:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126930.585878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11409:x1876035258851456:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 393us (571us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1789126930.585886:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1789126930.590383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.591387:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258851584 00000100:00100000:0.0:1789126930.591398:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258851584 00000100:00100000:0.0:1789126930.591452:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789126930.591461:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11409:x1876035258851584:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1789126930.591530:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591546:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591558:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591585:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591592:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591598:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591697:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591705:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591712:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126930.591754:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591765:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591771:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591778:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591783:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126930.591787:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591801:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591812:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126930.591816:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126930.591820:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591827:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eae37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591839:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591845:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591850:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.591855:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126930.592209:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592217:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592226:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:0.0:1789126930.592229:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126930.592232:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592247:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592258:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592263:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592270:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592275:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126930.592278:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592284:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592290:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126930.592292:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126930.592295:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.592300:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126930.592363:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11409:x1876035258851584:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 901us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126930.592371:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:2.0:1789126930.594804:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.594889:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258851840 00000100:00100000:3.0:1789126930.594899:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258851840 00000100:00100000:3.0:1789126930.594952:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789126930.594962:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11409:x1876035258851840:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126930.595193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:11409:x1876035258851840:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 232us (397us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789126930.595201:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1789126930.632176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.632265:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258852096 00000100:00100000:3.0:1789126930.632276:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258852096 00000100:00100000:3.0:1789126930.632340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1789126930.632351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:11412:x1876035258852096:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126930.632374:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126930.632395:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632488:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632503:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632516:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632529:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632542:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632642:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632688:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632696:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126930.632707:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789126930.632780:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632788:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632801:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632807:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.632827:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632837:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.632849:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126930.632852:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.632856:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eae53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633123:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633130:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633137:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633142:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148fa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.633146:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633163:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:3.0:1789126930.633174:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126930.633178:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633183:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633226:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633241:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.633247:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126930.633250:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126930.633252:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:3.0:1789126930.633361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11412:x1876035258852096:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1012us (1195us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789126930.633369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1789126930.643188:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.643342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258852224 00000100:00100000:3.0:1789126930.643351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258852224 00000100:00100000:3.0:1789126930.643412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1789126930.643423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11412:x1876035258852224:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126930.643507:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643537:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643571:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643579:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643587:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643593:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126930.643598:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643606:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643617:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126930.643621:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126930.643625:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.643632:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126930.643740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11412:x1876035258852224:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 319us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.643749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:2.0:1789126930.651911:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.654606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258852480 00000100:00100000:3.0:1789126930.654620:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258852480 00000100:00100000:3.0:1789126930.654707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1789126930.654718:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11412:x1876035258852480:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126930.655170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:11412:x1876035258852480:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 453us (3320us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789126930.655178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00010000:00010000:2.0:1789126930.858959:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126930.942625:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126930.942751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258852736 00000100:00100000:0.0:1789126930.942760:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258852736 00000100:00100000:0.0:1789126930.942824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1789126930.942835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:11443:x1876035258852736:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:0.0:1789126930.942858:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126930.942877:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.942977:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.942991:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.943003:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126930.943025:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789126930.943161:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eae76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3f5 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.943179:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3f5 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126930.943187:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126930.943190:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126930.943193:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cbc00, rc 0) 00000100:00100000:0.0:1789126930.943248:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11443:x1876035258852736:12345-192.168.203.23@tcp:101:cat.0 Request processed in 415us (632us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789126930.943273:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:1.0:1789126930.949473:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126930.949547:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258852864 00000100:00100000:3.0:1789126930.949556:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258852864 00000100:00100000:3.0:1789126930.949620:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789126930.949630:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:2393:x1876035258852864:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126930.949697:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126930.949722:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eae7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3f5 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126930.949741:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126930.949746:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126930.949801:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:2393:x1876035258852864:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 172us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126930.949809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1789126930.952128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126930.952294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258853120 00000100:00100000:1.0:1789126930.952302:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258853120 00000100:00100000:1.0:1789126930.952388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1789126930.952398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:11443:x1876035258853120:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:1.0:1789126930.952686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11443:x1876035258853120:12345-192.168.203.23@tcp:35:cat.0 Request processed in 289us (564us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789126930.952695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1789126931.019441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.019562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258853376 00000100:00100000:3.0:1789126931.019572:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258853376 00000100:00100000:3.0:1789126931.019706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1789126931.019715:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11449:x1876035258853376:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1789126931.019738:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126931.019741:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789126931.019767:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eade3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3cb expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019786:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126931.019790:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126931.019803:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c3fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019903:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019916:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019926:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019969:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.019984:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 38 pid: 6513 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126931.020002:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276771072:192.168.203.23@tcp:104: 00000100:00080000:0.0:1789126931.020161:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126931.020173:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942138d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126931.023558:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276771072:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126931.023587:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126931.029046:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.029145:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258853504 00000100:00100000:2.0:1789126931.029165:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258853504 00010000:00010000:2.0:1789126931.029223:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 39 pid: 6513 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126931.029264:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:2.0:1789126931.029274:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:2393:x1876035258853504:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126931.029287:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126931.029294:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 39 pid: 6513 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029308:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 39 pid: 6513 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029331:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eae61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3ee expref: 39 pid: 6513 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029348:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126931.029353:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029362:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029370:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.029401:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126931.029487:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.029495:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126931.029514:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789126931.029686:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eae8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.029701:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.029708:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.029711:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126931.029714:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126931.029795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:11449:x1876035258853376:12345-192.168.203.23@tcp:101:dd.0 Request processed in 10080us (10364us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789126931.029803:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:2.0:1789126931.029982:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:2393:x1876035258853504:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 709us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126931.029990:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:0.0:1789126931.032944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.038989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258853632 00000100:00100000:3.0:1789126931.039003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258853632 00000100:00100000:3.0:1789126931.039118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:3.0:1789126931.039129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11449:x1876035258853632:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1789126931.039181:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126931.039203:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eaea0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c403 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039237:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039263:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039371:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eaea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039390:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.039400:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.039404:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789126931.039408:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216ca00, rc 0) 00000100:00100000:3.0:1789126931.039483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:11449:x1876035258853632:12345-192.168.203.23@tcp:101:dd.0 Request processed in 356us (6547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126931.039490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1789126931.041427:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126931.041513:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258853888 00000100:00100000:0.0:1789126931.041522:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258853888 00000100:00100000:0.0:1789126931.041578:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:0.0:1789126931.041589:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:11449:x1876035258853888:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:0.0:1789126931.041864:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126931.041880:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126931.041890:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126931.041931:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789126931.041953:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000ad1d7ed reply state 00000000b01c1e01 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126931.041964:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126931.041972:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126931.041974:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789126931.041977:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789126931.042071:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:11449:x1876035258853888:12345-192.168.203.23@tcp:36:dd.0 Request processed in 483us (651us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789126931.042094:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000020:00080000:0.0:1789126931.042099:0:9524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789126931.116286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276771200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126931.116418:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126931.116615:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276771200 00000100:00100000:2.0:1789126931.116623:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276771200 00000100:00100000:2.0:1789126931.118370:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789126931.118389:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276771200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126931.118427:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126931.118515:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276771200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126931.118523:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789126931.118617:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276771200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126931.269370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.269529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258854016 00000100:00100000:3.0:1789126931.269552:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258854016 00000100:00100000:3.0:1789126931.269621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:3.0:1789126931.269633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:11463:x1876035258854016:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:3.0:1789126931.269695:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126931.269717:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaeb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c40a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269799:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269810:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269821:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269829:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269835:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269902:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269912:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269920:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269959:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.269973:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 43 pid: 6514 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126931.269987:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276771328:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126931.270264:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942138d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126931.271712:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276771328:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126931.271739:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126931.272670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.273223:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258854272 00000100:00100000:3.0:1789126931.273232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258854272 00000100:00100000:3.0:1789126931.273328:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1789126931.273339:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+44:6158:x1876035258854272:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789126931.273631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:6158:x1876035258854272:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 293us (986us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789126931.273640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1789126931.276542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.276629:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258854400 00000100:00100000:2.0:1789126931.276639:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258854400 00010000:00010000:2.0:1789126931.276694:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 45 pid: 6514 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126931.276736:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1789126931.276746:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:2394:x1876035258854400:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126931.276761:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126931.276768:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 45 pid: 6514 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276782:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 45 pid: 6514 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276803:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eae92 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3fc expref: 45 pid: 6514 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276837:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126931.276842:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276852:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276860:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.276895:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126931.276941:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+44:2394:x1876035258854400:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 197us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126931.276950:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00010000:00010000:1.0:1789126931.277116:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277125:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126931.277185:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789126931.277190:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126931.277228:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277241:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277258:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277265:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277271:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277276:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126931.277280:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277286:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277297:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126931.277300:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126931.277304:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277310:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaebc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277320:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277327:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277333:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277343:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126931.277347:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277353:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277361:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:1.0:1789126931.277364:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126931.277366:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277372:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277399:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaeb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c40a expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277412:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c40a expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.277419:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.277421:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126931.277423:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216c800, rc 0) 00000100:00100000:1.0:1789126931.277451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:11463:x1876035258854016:12345-192.168.203.23@tcp:101:stat.0 Request processed in 7822us (8093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126931.277459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1789126931.334537:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.334627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258854656 00000100:00100000:3.0:1789126931.334637:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258854656 00000100:00100000:3.0:1789126931.334724:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1789126931.334734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:11469:x1876035258854656:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:3.0:1789126931.334791:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126931.334817:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaeca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c40a expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.334850:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.334854:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126931.335036:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.335051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.335061:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126931.335102:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1789126931.335125:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006b7b7fad reply state 00000000d6e5d585 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.335614:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.335621:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.335624:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126931.335627:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126931.335846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:11469:x1876035258854656:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 1110us (1314us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789126931.335855:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000020:00080000:3.0:1789126931.335861:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789126931.463688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.463813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258854784 00000100:00100000:3.0:1789126931.463823:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258854784 00000100:00100000:3.0:1789126931.463881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1789126931.463892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:11483:x1876035258854784:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:3.0:1789126931.463935:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126931.463957:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaed8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c411 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464036:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464050:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464063:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464075:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464080:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464086:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464154:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464163:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464169:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126931.464208:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789126931.464219:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126931.464243:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464254:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464262:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464268:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464275:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464281:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126931.464286:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464293:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464305:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126931.464308:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126931.464313:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464319:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eaedf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464332:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464348:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464354:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464359:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126931.464362:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464368:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464376:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:3.0:1789126931.464379:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126931.464381:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464388:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eaee6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464417:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eaed8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464429:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.464436:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.464439:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126931.464447:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126931.464517:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:11483:x1876035258854784:12345-192.168.203.23@tcp:101:stat.0 Request processed in 625us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126931.464524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1789126931.526124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.526455:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258855040 00000100:00100000:2.0:1789126931.526469:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258855040 00000100:00100000:2.0:1789126931.526539:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:2.0:1789126931.526552:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:11493:x1876035258855040:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126931.526573:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126931.526593:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c418 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126931.526754:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789126931.526846:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaef4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c418 expref: 48 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.526878:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:2.0:1789126931.526881:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126931.526886:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c418 expref: 48 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.526900:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126931.526965:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:11493:x1876035258855040:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 416us (855us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789126931.526973:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:2.0:1789126931.533086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.533267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258855296 00000100:00100000:1.0:1789126931.533276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258855296 00000100:00100000:1.0:1789126931.533436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1789126931.533448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:11493:x1876035258855296:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126931.533705:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+48:11493:x1876035258855296:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 258us (626us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789126931.533713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1789126931.610525:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.610741:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258855552 00000100:00100000:3.0:1789126931.610755:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258855552 00000100:00100000:2.0:1789126931.612316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:2.0:1789126931.612340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941042d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+48:11499:x1876035258855552:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126931.612450:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126931.612482:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaf02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c41f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.612629:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.612769:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.612827:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.612879:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.612914:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 49 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126931.612932:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276771456:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126931.614556:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213befcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126931.622384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.622493:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258855680 00000100:00100000:1.0:1789126931.622505:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258855680 00010000:00010000:1.0:1789126931.622559:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 50 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126931.622624:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:1.0:1789126931.622636:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:2393:x1876035258855680:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126931.622689:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126931.622697:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 50 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.622713:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 50 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.622741:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.622747:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.622760:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.622791:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.622814:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126931.622899:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:2393:x1876035258855680:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 264us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126931.622908:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00010000:00010000:2.0:1789126931.623285:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eaeed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c411 expref: 49 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126931.623307:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276771456:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126931.623336:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.623704:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.623711:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126931.623735:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789126931.625264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaf02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.625293:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.625304:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126931.625326:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789126931.625331:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126931.625714:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941042d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:11499:x1876035258855552:12345-192.168.203.23@tcp:101:bash.0 Request processed in 13381us (15200us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789126931.625725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000004:00080000:1.0:1789126931.628106:0:8905:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356832453646ns, next at 357832449643ns, rc = 0 00000100:00100000:2.0:1789126931.628194:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126931.628219:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276771584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126931.628301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126931.628553:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276771584 00000100:00100000:1.0:1789126931.628563:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276771584 00000100:00100000:1.0:1789126931.628643:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126931.628682:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276771584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126931.628711:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126931.628769:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276771584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126931.628777:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789126931.628840:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276771584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789126931.629023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126931.629060:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126931.629406:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276771712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126931.629454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126931.629553:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276771712 00000100:00100000:3.0:1789126931.629559:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276771712 00000100:00100000:3.0:1789126931.629643:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789126931.629684:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276771712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126931.629701:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126931.629742:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276771712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126931.629750:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789126931.629785:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276771712:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789126931.630077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126931.631772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.631873:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258855936 00000100:00100000:1.0:1789126931.631883:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258855936 00000100:00100000:1.0:1789126931.631954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:1.0:1789126931.631966:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:11499:x1876035258855936:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:1.0:1789126931.632286:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.632308:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.632522:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126931.632579:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789126931.632616:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000098c756cc reply state 00000000d1cbed7d transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.632632:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.632640:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.632643:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789126931.632730:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126931.632844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:11499:x1876035258855936:12345-192.168.203.23@tcp:36:bash.0 Request processed in 879us (1083us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789126931.632964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000020:00080000:1.0:1789126931.632971:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789126931.638812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.639154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258856064 00000100:00100000:1.0:1789126931.639167:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258856064 00000100:00100000:1.0:1789126931.639253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:1.0:1789126931.639266:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:11499:x1876035258856064:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1789126931.639300:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126931.639330:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a400/0xa840b4da666eaf1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c426 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.639466:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.639485:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.639515:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.639559:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.639576:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 53 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126931.639595:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276771840:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126931.639735:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789126931.643552:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.643800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258856192 00000100:00100000:3.0:1789126931.643812:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258856192 00010000:00010000:3.0:1789126931.643865:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 54 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126931.643910:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1789126931.643920:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:2393:x1876035258856192:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126931.643936:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126931.643943:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 54 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.643958:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 54 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.644018:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.644024:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.644036:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.644044:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.644066:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126931.644134:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:2393:x1876035258856192:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 216us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126931.644142:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00010000:00010000:1.0:1789126931.644561:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eaf09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c41f expref: 53 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126931.644586:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276771840:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126931.644610:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.644620:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.644626:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126931.644758:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789126931.644763:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126931.644789:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.644839:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a400/0xa840b4da666eaf1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c426 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.644857:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c426 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.644865:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.644868:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126931.644872:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420166be00, rc 0) 00000100:00100000:1.0:1789126931.644916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:11499:x1876035258856064:12345-192.168.203.23@tcp:101:bash.0 Request processed in 5653us (6122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126931.644924:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1789126931.647783:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.647874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258856448 00000100:00100000:3.0:1789126931.647886:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258856448 00000100:00100000:3.0:1789126931.647954:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789126931.647965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212267c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:11499:x1876035258856448:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1789126931.648573:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212267c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11499:x1876035258856448:12345-192.168.203.23@tcp:35:bash.0 Request processed in 606us (801us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789126931.648583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1789126931.719565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.719827:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258856704 00000100:00100000:2.0:1789126931.719841:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258856704 00000100:00100000:2.0:1789126931.719963:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:2.0:1789126931.719975:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11509:x1876035258856704:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126931.720024:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126931.720053:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c42d expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126931.720190:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789126931.720319:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaf2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c42d expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.720337:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:2.0:1789126931.720340:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126931.720347:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eaf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c42d expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.720388:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126931.720563:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11509:x1876035258856704:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 590us (1013us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789126931.720571:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1789126931.723397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.723493:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258856832 00000100:00100000:2.0:1789126931.723505:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258856832 00000100:00100000:2.0:1789126931.723642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:2.0:1789126931.723689:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11509:x1876035258856832:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1789126931.723782:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723801:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723814:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723825:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723833:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723839:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723943:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723973:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.723981:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126931.724050:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724066:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724073:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724080:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724087:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126931.724092:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724100:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724113:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126931.724116:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126931.724121:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724128:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724151:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724157:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724163:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724168:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126931.724171:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724177:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724185:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:2.0:1789126931.724188:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126931.724191:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724198:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724210:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724217:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724223:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724235:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126931.724238:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724245:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724254:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126931.724256:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126931.724259:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.724265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126931.724350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11509:x1876035258856832:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 662us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126931.724360:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1789126931.727439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.727574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258857088 00000100:00100000:3.0:1789126931.727585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258857088 00000100:00100000:3.0:1789126931.727674:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789126931.727686:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11509:x1876035258857088:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126931.728094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:11509:x1876035258857088:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 409us (667us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789126931.728123:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789126931.765550:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.765716:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258857344 00000100:00100000:1.0:1789126931.765729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258857344 00000100:00100000:1.0:1789126931.765865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:1.0:1789126931.765879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:11512:x1876035258857344:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126931.765912:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126931.765941:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a400/0xa840b4da666eaf4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c434 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766148:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766167:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766181:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766229:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766238:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766246:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766498:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eaf64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766510:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eaf64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766517:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eaf64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126931.766528:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789126931.766625:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766633:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766640:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766760:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166a000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126931.766766:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766787:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766803:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126931.766806:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126931.766812:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766819:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a000/0xa840b4da666eaf56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766834:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766841:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766847:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766914:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126931.766918:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766924:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766932:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:1.0:1789126931.766934:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126931.766937:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.766953:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eaf5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.767064:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166a400/0xa840b4da666eaf4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c434 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.767079:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eaf64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c434 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.767086:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.767089:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126931.767092:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397e00, rc 0) 00000100:00100000:1.0:1789126931.767315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:11512:x1876035258857344:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1437us (1776us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789126931.767324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1789126931.771583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126931.771739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126931.771765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258857472 00000100:00100000:1.0:1789126931.771776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258857472 00000100:00100000:1.0:1789126931.771846:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:1.0:1789126931.771855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:11512:x1876035258857472:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1789126931.772095:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772118:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772132:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772201:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772208:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772215:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772222:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126931.772227:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772235:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772250:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:1.0:1789126931.772254:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789126931.772260:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126931.772267:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126931.772615:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:11512:x1876035258857472:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 757us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126931.772625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:3.0:1789126931.772691:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258857600 00000100:00100000:3.0:1789126931.772698:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258857600 00000100:00100000:3.0:1789126931.772788:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1789126931.772799:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:2391:x1876035258857600:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126931.772814:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126931.772835:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eaf64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c434 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126931.772849:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126931.772860:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126931.772935:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:2391:x1876035258857600:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 138us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126931.772943:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1789126931.776762:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126931.777173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258857856 00000100:00100000:3.0:1789126931.777187:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258857856 00000100:00100000:3.0:1789126931.777259:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1789126931.777271:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:11512:x1876035258857856:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126931.777779:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:11512:x1876035258857856:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 508us (1030us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789126931.777788:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00010000:00010000:0.0:1789126931.883321:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126931.957154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126931.957270:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258858112 00000100:00100000:2.0:1789126931.957284:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258858112 00000100:00100000:2.0:1789126931.957367:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:2.0:1789126931.957380:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:11530:x1876035258858112:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1789126931.957413:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126931.957443:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c43b expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.957588:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.957630:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.957645:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126931.957686:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789126931.957831:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c43b expref: 60 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.957853:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c43b expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126931.957862:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126931.957865:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789126931.957870:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3a00, rc 0) 00000100:00100000:2.0:1789126931.960552:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11530:x1876035258858112:12345-192.168.203.23@tcp:101:cat.0 Request processed in 3158us (3397us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789126931.960570:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:0.0:1789126932.003465:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.003639:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258858240 00000100:00100000:2.0:1789126932.003684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258858240 00000100:00100000:2.0:1789126932.003765:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1789126932.003780:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11531:x1876035258858240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126932.003813:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126932.003840:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c442 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.003958:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.003976:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.003990:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126932.004057:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789126932.004061:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126932.004086:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.004118:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eaf8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c442 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.004142:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c442 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.004151:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126932.004154:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126932.004159:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:2.0:1789126932.004241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11531:x1876035258858240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 467us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.004249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:0.0:1789126932.019403:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.019634:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258858624 00000100:00100000:1.0:1789126932.019669:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258858624 00000100:00100000:1.0:1789126932.019755:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1789126932.019777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11531:x1876035258858624:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126932.020436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11531:x1876035258858624:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 658us (1047us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789126932.020447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1789126932.025928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.026103:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258858752 00000100:00100000:2.0:1789126932.026117:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258858752 00000100:00100000:2.0:1789126932.026230:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1789126932.026243:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11531:x1876035258858752:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:2.0:1789126932.026262:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789126932.026294:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166be00/0xa840b4da666eaf25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c426 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.026326:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eaf80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c43b expref: 60 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.026340:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eae22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3e0 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.026353:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126932.026359:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126932.026436:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11531:x1876035258858752:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 196us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.026445:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789126932.029161:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.029317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258858880 00000100:00100000:1.0:1789126932.029330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258858880 00000100:00100000:1.0:1789126932.029407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:1.0:1789126932.029419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11531:x1876035258858880:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:1.0:1789126932.029585:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.029610:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.029626:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789126932.029985:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789126932.030384:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789126932.030485:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789126932.030887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11531:x1876035258858880:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 1463us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.030900:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:0.0:1789126932.058328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.058449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859008 00000100:00100000:2.0:1789126932.058464:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859008 00000100:00100000:2.0:1789126932.058547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1789126932.058559:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11533:x1876035258859008:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126932.058591:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126932.058619:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafa3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c449 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058749:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058791:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058806:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058821:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058828:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058835:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058925:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058935:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.058943:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126932.059012:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789126932.059018:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126932.059041:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059055:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059075:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059083:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059090:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059097:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126932.059102:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059111:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059287:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126932.059292:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126932.059299:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059306:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eafaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059322:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059329:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059335:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059347:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126932.059350:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059357:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059365:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:2.0:1789126932.059368:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126932.059370:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059376:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059408:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059422:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.059430:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126932.059432:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126932.059435:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:2.0:1789126932.059750:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11533:x1876035258859008:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1191us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.059759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:3.0:1789126932.658679:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126932.658709:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276771968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126932.658810:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126932.658898:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276771968 00000100:00100000:3.0:1789126932.658914:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276771968 00000100:00100000:3.0:1789126932.658971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789126932.658982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276771968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126932.659035:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1789126932.659092:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276771968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.659100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789126932.659156:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276771968:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789126932.715507:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126932.715590:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789126932.715930:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789126932.715943:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789126932.716170:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276772096:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789126932.716329:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126932.719731:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104840780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276772096:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789126932.720783:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.720916:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859136 00000100:00100000:2.0:1789126932.720962:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859136 00000100:00100000:2.0:1789126932.721052:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1789126932.721064:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11544:x1876035258859136:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789126932.721117:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789126932.721269:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11544:x1876035258859136:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 207us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.721278:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:0.0:1789126932.728365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.728509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859264 00000100:00100000:1.0:1789126932.728523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859264 00000100:00100000:1.0:1789126932.728604:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1789126932.728616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11544:x1876035258859264:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.728770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.728792:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.728807:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729221:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729241:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729283:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729294:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729300:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126932.729372:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789126932.729378:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126932.729398:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729413:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729420:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729427:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729434:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.729439:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729466:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729480:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:0.0:1789126932.729484:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.729490:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729497:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eafbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729519:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729526:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729533:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729539:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.729542:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729548:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729556:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff994102e04e00) 00010000:00010000:0.0:1789126932.729559:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.729562:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729578:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eafc6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729598:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729605:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729611:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729616:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.729620:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729625:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729633:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126932.729635:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.729644:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.729693:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eafcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.730068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11544:x1876035258859264:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 1450us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126932.730079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1789126932.734351:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.734535:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859520 00000100:00100000:2.0:1789126932.734548:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859520 00000100:00100000:2.0:1789126932.734620:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:2.0:1789126932.734632:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11544:x1876035258859520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126932.734679:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126932.734706:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c450 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734834:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734849:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734860:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126932.734869:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789126932.734958:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734964:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734983:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.734988:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126932.734991:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735008:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735026:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126932.735030:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126932.735035:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735042:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eafdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735093:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafd4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c450 expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735103:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:2.0:1789126932.735106:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126932.735110:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eafd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c450 expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.735120:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126932.735203:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258859520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 573us (866us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789126932.735220:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:1.0:1789126932.741301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.741402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859648 00000100:00100000:0.0:1789126932.741417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859648 00000100:00100000:0.0:1789126932.741490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:0.0:1789126932.741503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258859648:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789126932.741549:0:6512:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789126932.741729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258859648:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 228us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126932.741738:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1789126932.746308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.747222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258859904 00000100:00100000:1.0:1789126932.747235:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258859904 00000100:00100000:1.0:1789126932.747962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1789126932.747975:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258859904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.748013:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126932.748017:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789126932.748053:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eaf95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c442 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748072:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126932.748078:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126932.748097:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eafe9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c457 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789126932.748585:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789126932.748800:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eaff0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748815:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eaff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748828:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eaff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748890:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eafe9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c457 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748908:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eaff0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c457 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.748917:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9942139b7b00) 00010000:00010000:1.0:1789126932.748920:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126932.748922:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397400, rc 0) 00000100:00100000:1.0:1789126932.749020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11544:x1876035258859904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1047us (2726us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789126932.749031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:2.0:1789126932.753894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.754060:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860160 00000100:00100000:0.0:1789126932.754073:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860160 00000100:00100000:0.0:1789126932.754175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:0.0:1789126932.754187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11544:x1876035258860160:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789126932.754264:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126932.754299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eaff0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c457 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754320:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9942139b7b00) 00010000:00010000:0.0:1789126932.754332:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126932.754364:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754393:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754410:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754426:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754434:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754488:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754497:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754504:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754511:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.754516:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754525:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754536:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126932.754539:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.754543:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754550:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eaffe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754560:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754575:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754581:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754586:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.754590:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754595:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754602:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa9b4f36a (ffff994102e04e00) 00010000:00010000:0.0:1789126932.754604:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.754608:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.754614:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb005 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa9b4f36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.754842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258860160:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 655us (959us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789126932.754851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:1.0:1789126932.757638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.757763:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860288 00000100:00100000:2.0:1789126932.757775:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860288 00000100:00100000:2.0:1789126932.757845:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:2.0:1789126932.757857:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11544:x1876035258860288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126932.757882:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126932.757920:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb00c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c45e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.757972:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.757989:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.758014:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.758151:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb00c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.758174:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.758184:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:2.0:1789126932.758188:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789126932.758192:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126932.758276:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11544:x1876035258860288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 420us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.758284:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:2.0:1789126932.769791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.770776:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860544 00000100:00100000:1.0:1789126932.770794:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860544 00000100:00100000:1.0:1789126932.770880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:1.0:1789126932.770894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11544:x1876035258860544:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.771026:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.771047:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.771062:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789126932.771282:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789126932.771293:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357975643201ns, next at 358975640114ns, rc = 0 00000004:00010000:1.0:1789126932.771356:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000079f804d reply state 00000000515eb81d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.771373:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.771382:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:1.0:1789126932.771386:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789126932.771390:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126932.771533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11544:x1876035258860544:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 642us (1756us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789126932.771541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:0.0:1789126932.775557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.780681:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860672 00000100:00100000:1.0:1789126932.780703:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860672 00000100:00100000:1.0:1789126932.780795:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1789126932.780806:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11544:x1876035258860672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.780837:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126932.780868:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c465 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.780979:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.781008:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.781033:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:1.0:1789126932.781037:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126932.781042:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396a00, rc 0) 00000100:00100000:1.0:1789126932.781142:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:11544:x1876035258860672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 337us (5600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.781152:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1789126932.783537:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.787017:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860800 00000100:00100000:2.0:1789126932.787034:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860800 00000100:00100000:2.0:1789126932.787105:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1789126932.787117:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258860800:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789126932.787162:0:8428:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:2.0:1789126932.787202:0:8428:0:(genops.c:1385:class_connect()) connect: client 7cbe914d-2346-44a4-9fd5-22d31c7628a2, cookie 0xa840b4da666eb028 00002000:00100000:2.0:1789126932.787220:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7cbe914d-2346-44a4-9fd5-22d31c7628a2/ffff9942118e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789126932.787242:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789126932.787351:0:8428:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789126932.787402:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9942118e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789126932.787501:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2390:x1876035258860800:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 Request processed in 385us (3977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.787513:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1789126932.791326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.791734:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258860928 00000100:00100000:0.0:1789126932.791747:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258860928 00000100:00100000:0.0:1789126932.791841:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1789126932.791855:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:0:x1876035258860928:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789126932.792342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789126932.797248:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1789126932.797268:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000100:00100000:3.0:1789126932.797487:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:0:x1876035258860928:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 5627us (6170us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789126932.797502:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1789126932.806116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.806826:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861184 00000100:00100000:3.0:1789126932.806841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861184 00000100:00100000:3.0:1789126932.806925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789126932.806936:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:11544:x1876035258861184:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789126932.809551:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11544:x1876035258861184:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 2601us (3430us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789126932.809568:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1789126932.820984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.821153:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861568 00000100:00100000:1.0:1789126932.821164:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861568 00000100:00100000:3.0:1789126932.821195:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861824 00000100:00100000:3.0:1789126932.821202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861824 00000100:00100000:1.0:1789126932.821239:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1789126932.821241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861440 00000100:00100000:3.0:1789126932.821246:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861440 00000100:00100000:1.0:1789126932.821253:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258861568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126932.821263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861696 00000100:00100000:3.0:1789126932.821267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861696 00000100:00100000:3.0:1789126932.821297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862080 00000100:00100000:3.0:1789126932.821300:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862080 00000100:00100000:3.0:1789126932.821318:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00100000:3.0:1789126932.821327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258861824:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126932.821342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258861568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.821367:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1789126932.821380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258861824:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.821389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 281 00000100:00100000:1.0:1789126932.821404:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 282 00000100:00100000:1.0:1789126932.821414:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258861440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126932.821421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:3.0:1789126932.821431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258861696:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126932.821447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258861440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.821455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 282 00000100:00100000:3.0:1789126932.821465:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258861696:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.821473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 283 00000100:00100000:1.0:1789126932.821479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:1.0:1789126932.821489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11544:x1876035258862080:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00080000:3.0:1789126932.821537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126932.821543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126932.821546:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126932.821566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11544:x1876035258862080:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 78us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.821573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:0.0:1789126932.821929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258861312 00000100:00100000:0.0:1789126932.821935:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258861312 00000100:00100000:0.0:1789126932.821973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 438 00000100:00100000:0.0:1789126932.821981:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258861312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126932.822027:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258861312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 47us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126932.822034:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 438 00000100:00100000:3.0:1789126932.825289:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.825772:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862208 00000100:00100000:3.0:1789126932.825783:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862208 00000100:00100000:3.0:1789126932.826007:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:3.0:1789126932.826021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11544:x1876035258862208:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126932.828713:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126932.828786:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb02f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c46c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.828879:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.828977:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.829003:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126932.829117:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126932.829142:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.829177:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb02f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c46c expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.829195:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c46c expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.829205:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:3.0:1789126932.829209:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789126932.829213:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126932.829299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942366261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11544:x1876035258862208:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3280us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.829309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:0.0:1789126932.837766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.837863:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862336 00000100:00100000:3.0:1789126932.837876:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862336 00000100:00100000:3.0:1789126932.837944:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1789126932.837957:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258862336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126932.837988:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126932.838037:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c473 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126932.838069:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3e914, blocks: 0x0 00010000:00010000:3.0:1789126932.838094:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789126932.838101:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126932.838112:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.838254:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.838272:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126932.838341:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258862336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 385us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.838350:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1789126932.842049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.842190:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862592 00000100:00100000:3.0:1789126932.842201:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862592 00000100:00100000:3.0:1789126932.842300:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1789126932.842313:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11544:x1876035258862592:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789126932.842453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11544:x1876035258862592:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.842462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:0.0:1789126932.845521:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.845609:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862720 00000100:00100000:1.0:1789126932.845620:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862720 00000100:00100000:0.0:1789126932.846252:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1789126932.846268:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:11544:x1876035258862720:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126932.846289:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126932.846315:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c47a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.846352:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.846363:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126932.846369:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126932.846375:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.846431:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.846448:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.846464:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276772224:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126932.846582:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126932.849796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.849860:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276772224:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126932.849900:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.849928:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca000, rc 0) 00000100:00100000:2.0:1789126932.850018:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11544:x1876035258862720:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3754us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.850030:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862848 00000100:00100000:1.0:1789126932.850041:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862848 00000100:00100000:2.0:1789126932.850045:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00010000:00010000:1.0:1789126932.850089:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.850133:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:1.0:1789126932.850144:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258862848:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126932.850161:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126932.850188:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.850216:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.850249:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052674e40/0xa840b4da666eb03d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c473 expref: 7 pid: 8430 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.850263:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126932.850268:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126932.850278:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.850291:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.850335:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.850441:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876035276772352:192.168.203.23@tcp:105: 00000100:00100000:1.0:1789126932.850518:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126932.857454:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876035276772352:192.168.203.23@tcp:105: 00000100:00100000:0.0:1789126932.857455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:1.0:1789126932.857488:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126932.857557:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258862848:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 7414us (7776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.857571:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:3.0:1789126932.857726:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258862976 00000100:00100000:3.0:1789126932.857736:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258862976 00002000:00100000:3.0:1789126932.857798:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9941041fb480 x1876035258862976/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:423/0 lens 504/0 e 0 to 0 dl 1789126943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126932.857809:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941041fb480 with x1876035258862976 ext(0->8) 00002000:00010000:3.0:1789126932.857816:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941041fb480 00000100:00100000:3.0:1789126932.857859:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1789126932.857870:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258862976:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789126932.861096:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258862976:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 3216us (3638us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789126932.861113:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:3.0:1789126932.861127:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9941041fb480 x1876035258862976/t4294967303(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:423/0 lens 504/448 e 0 to 0 dl 1789126943 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126932.861138:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941041fb480 with x1876035258862976 ext(0->8) 00002000:00010000:3.0:1789126932.861145:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941041fb480 00000100:00100000:3.0:1789126932.869898:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.870154:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258863104 00000100:00100000:1.0:1789126932.870168:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258863104 00000100:00100000:1.0:1789126932.870244:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:1.0:1789126932.870256:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11544:x1876035258863104:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789126932.872380:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789126932.872403:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789126932.872460:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1789126932.872512:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789126932.872524:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994103cf4000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789126932.872530:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99423d14d200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994103cf4840 00000020:00080000:2.0:1789126932.872533:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9942107eeb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994202f5ca00 00000020:00080000:1.0:1789126932.872688:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:3.0:1789126932.872691:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872707:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872717:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872726:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.872733:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872755:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872780:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994236490800) 00010000:00010000:3.0:1789126932.872784:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.872791:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872798:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ead5e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872823:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872831:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.872837:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789126932.872900:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789126932.872925:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276772480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789126932.873056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126932.873089:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276772608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789126932.873145:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276772480 00000100:00100000:1.0:1789126932.873154:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276772480 00000100:00100000:2.0:1789126932.873204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126932.873220:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276772608 00000100:00100000:1.0:1789126932.873225:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276772608 00000100:00100000:1.0:1789126932.873259:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789126932.873270:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276772480:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789126932.873284:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.873288:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873296:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873307:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126932.873310:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.873313:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873330:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666ead65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873348:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873354:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873360:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873366:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.873369:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873375:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873383:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490e00) 00010000:00010000:3.0:1789126932.873386:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.873389:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873395:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eada4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873412:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873420:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873433:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873439:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.873442:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873450:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873459:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126932.873462:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.873465:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873473:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eaeae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873489:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873497:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873503:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873509:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216dc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.873512:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873530:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873541:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126932.873544:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.873547:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873554:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eaed1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873569:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873575:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873582:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789126932.873583:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789126932.873590:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789126932 00010000:00010000:3.0:1789126932.873593:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166b800 already unused, calling callback (ffffffffc193f4f0) 00002000:00010000:1.0:1789126932.873595:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1789126932.873599:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789126932.873600:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789126932 -> 1789126932 00002000:00010000:1.0:1789126932.873606:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789126932.873613:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873624:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126932.873627:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126932.873630:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873673:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420166b800/0xa840b4da666eaf17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873692:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.873699:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276772480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 428us (642us total) trans 4294967304 rc 0/0 00010000:00010000:3.0:1789126932.873703:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873713:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873719:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126932.873722:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873729:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873739:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:3.0:1789126932.873741:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789126932.873744:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.873751:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb01a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126932.873814:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789126932.873823:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789126932.873828:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276772608:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789126932.873853:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789126932.873911:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104843480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789126932.873918:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276772480:0@lo:2:osp-syn-1-0.0 00002000:00080000:2.0:1789126932.873920:0:8429:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789126932.873959:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3e911, atime: 0x6aa3e912, ctime: 0x6aa3e911, blocks: 0x8 00010000:00010000:2.0:1789126932.873968:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.873986:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1789126932.873992:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126932.874011:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.874033:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.874055:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.874063:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.874088:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789126932.874110:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:11544:x1876035258863104:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 3854us (4224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126932.874131:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:2.0:1789126932.875440:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1876035276772608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1611us (2230us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789126932.875454:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789126932.875519:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104841e00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789126932.875526:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276772608:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789126932.876556:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789126932.876573:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.876601:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126932.876606:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.876619:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.876680:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.876689:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666eb04b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.876714:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126932.876716:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126932.876718:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126932.879961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.880044:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258863232 00000100:00100000:0.0:1789126932.880056:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258863232 00000100:00100000:0.0:1789126932.880133:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1789126932.880145:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258863232:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789126932.886083:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789126932.886104:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789126932.886270:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258863232:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 6120us (6318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.886285:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000040:00080000:2.0:1789126932.888542:0:14892:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126932.888556:0:14892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126932.888589:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789126932.888599:0:14892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789126932.892052:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.897537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258863488 00000100:00100000:0.0:1789126932.897554:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258863488 00000100:00100000:0.0:1789126932.897705:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:0.0:1789126932.897717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:11544:x1876035258863488:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789126932.897803:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126932.898244:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c46c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.898267:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.898273:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126932.898315:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.898340:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.898352:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126932.898510:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bc817b00 reply state 000000005553a8f8 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.898523:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.898529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.898532:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789126932.898535:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789126932.898695:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:11544:x1876035258863488:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 978us (6656us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789126932.898705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:3.0:1789126932.904558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126932.904704:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258863616 00000100:00100000:2.0:1789126932.904718:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258863616 00000100:00100000:2.0:1789126932.904791:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1789126932.904804:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258863616:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789126932.905108:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789126932.905112:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789126932 -> 1789126931 00002000:00010000:2.0:1789126932.905115:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789126930 00002000:00010000:2.0:1789126932.905118:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789126932 -> 1789126931 00002000:00010000:2.0:1789126932.905120:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789126932.905972:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258863616:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 1164us (1420us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789126932.905984:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00010000:00010000:1.0:1789126932.907974:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126932.909444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.909541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258863872 00000100:00100000:3.0:1789126932.909553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258863872 00000100:00100000:3.0:1789126932.909706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:3.0:1789126932.909729:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:11544:x1876035258863872:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789126932.909831:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.910072:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 15 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.910086:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.910140:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 15 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.910157:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 15 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126932.910175:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276772736:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126932.910293:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126932.918263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.918574:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864000 00000100:00100000:0.0:1789126932.918584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864000 00010000:00010000:0.0:1789126932.918641:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 16 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.918714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1789126932.918727:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:2393:x1876035258864000:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126932.918746:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789126932.919105:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276772736:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126932.919137:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919175:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 16 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919207:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 16 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919237:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb013 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c45e expref: 16 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919253:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.919259:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919272:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919281:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.919312:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126932.919384:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919398:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.919398:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:2393:x1876035258864000:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 671us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126932.919415:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00010000:00010000:2.0:1789126932.919456:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919465:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919472:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919479:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126932.919485:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919495:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919506:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:2.0:1789126932.919509:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789126932.919515:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.919523:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb059 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126932.919583:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:11544:x1876035258863872:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 9858us (10148us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789126932.919593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:3.0:1789126932.924044:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.924341:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864128 00000100:00100000:1.0:1789126932.924354:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864128 00000100:00100000:1.0:1789126932.924428:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:1.0:1789126932.924442:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258864128:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.924502:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.924528:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.924539:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126932.924545:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126932.924550:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.924597:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.924614:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 7 pid: 8428 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.924632:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104840b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276772864:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126932.924778:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789126932.934706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.934744:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104840b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276772864:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126932.934783:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.934884:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864256 00000100:00100000:0.0:1789126932.934893:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864256 00010000:00010000:0.0:1789126932.934943:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 8 pid: 8428 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.935069:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:0.0:1789126932.935083:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258864256:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126932.935113:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126932.935146:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 8 pid: 8428 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.935162:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 8 pid: 8428 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.935262:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5eeb14e/0xa840b4da666eb044 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c47a expref: 8 pid: 8428 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.935292:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126932.935298:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126932.935305:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.935319:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.935356:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126932.935424:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.935433:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258864256:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 351us (790us total) trans 0 rc 0/0 00010000:00010000:3.0:1789126932.935441:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.935446:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00010000:00010000:3.0:1789126932.935477:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935486:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935496:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935504:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126932.935509:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935520:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935534:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.935543:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2f29479/0xa840b4da666eb060 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126932.935597:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258864128:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 11159us (11569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.935606:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789126932.939319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.939908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864512 00000100:00100000:1.0:1789126932.939921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864512 00000100:00100000:1.0:1789126932.940006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:1.0:1789126932.940018:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:11544:x1876035258864512:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789126932.940409:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.940431:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.940442:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.940486:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.940501:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 14 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.940517:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104840b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276772992:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126932.940618:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789126932.952185:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126932.952259:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104840b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276772992:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126932.952295:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126932.952302:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864640 00000100:00100000:2.0:1789126932.952312:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864640 00010000:00010000:2.0:1789126932.952358:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 15 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126932.952409:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:2.0:1789126932.952422:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104842940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:2394:x1876035258864640:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126932.952440:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126932.952450:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 15 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952465:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 15 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952495:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eaea7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c403 expref: 15 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952514:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:2.0:1789126932.952520:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952532:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952564:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126932.952602:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126932.952984:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104842940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:2394:x1876035258864640:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 561us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.953009:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00010000:00010000:1.0:1789126932.953057:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953082:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953344:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953358:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 14 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953367:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953402:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 14 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.953418:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 14 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126932.953433:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104842580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276773120:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126932.953502:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789126932.960739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.960860:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104842580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276773120:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126932.960893:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.960929:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864768 00000100:00100000:0.0:1789126932.960946:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864768 00010000:00010000:0.0:1789126932.961283:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 15 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.961332:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:0.0:1789126932.961344:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:2391:x1876035258864768:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126932.961366:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126932.961375:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 15 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961391:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 15 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961424:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb021 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c465 expref: 15 pid: 9524 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961443:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.961449:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961462:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961472:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961501:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126932.961568:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:2391:x1876035258864768:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 226us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126932.961587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00010000:00010000:0.0:1789126932.961934:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.961943:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126932.962103:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789126932.962327:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789126932.962371:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789126932.962492:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276773248:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789126932.962556:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126932.962592:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126932.964513:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276773248 00000100:00100000:2.0:1789126932.964531:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276773248 00000100:00100000:2.0:1789126932.964939:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789126932.964954:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1876035276773248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789126932.965154:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1876035276773248:12345-0@lo:1000:mdt00_000.0 Request processed in 204us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126932.965165:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789126932.965459:0:6512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789126932.965468:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104843480, transno 4294967304 00000100:00100000:0.0:1789126932.965498:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276773248:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789126932.965755:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789126932.965850:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276773376:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789126932.965906:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126932.965933:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126932.966131:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276773376 00000100:00100000:3.0:1789126932.966138:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276773376 00000100:00100000:3.0:1789126932.966298:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789126932.966313:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1876035276773376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789126932.966462:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1876035276773376:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (556us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789126932.966471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789126932.966559:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276773376:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789126932.966608:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966620:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966629:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966645:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.966734:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966745:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966766:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.966770:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789126932.966776:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966783:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb06e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966821:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966829:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966835:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966841:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.966844:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966850:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966872:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126932.966874:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789126932.966878:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966884:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eaf9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966912:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966929:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966939:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966975:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.966991:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.967014:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276773504:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126932.967147:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09180 going to sleep for 11 seconds 00000100:00100000:2.0:1789126932.976547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126932.976678:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276773504:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126932.976715:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126932.976993:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258864896 00000100:00100000:3.0:1789126932.977010:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258864896 00010000:00010000:3.0:1789126932.977055:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126932.977091:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:3.0:1789126932.977101:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:2394:x1876035258864896:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126932.977126:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126932.977134:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977147:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977173:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eafb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c449 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977291:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:3.0:1789126932.977297:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977308:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977317:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126932.977345:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126932.977401:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:2394:x1876035258864896:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 301us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126932.977409:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00010000:00010000:0.0:1789126932.977643:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977674:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977686:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977694:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977700:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977706:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.977711:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977719:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977728:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126932.977730:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126932.977733:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977739:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb075 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977751:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977763:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977769:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977773:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126932.977776:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977781:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977788:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994102e04500) 00010000:00010000:0.0:1789126932.977790:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789126932.977792:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.977797:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb067 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126932.977964:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11544:x1876035258864512:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 37948us (38668us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789126932.977973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000020:00080000:0.0:1789126932.977976:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789126932.978768:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126932.978776:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126932.978793:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789126932.978830:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126932.982445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126932.982532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258865152 00000100:00100000:1.0:1789126932.982544:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258865152 00000100:00100000:1.0:1789126932.982610:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789126932.982621:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11544:x1876035258865152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789126932.982937:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789126932.982975:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789126932.983026:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983056:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983072:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983083:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983090:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983097:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126932.983127:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789126932.983305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:11544:x1876035258865152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 685us (872us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789126932.983315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000020:00080000:1.0:1789126932.983321:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789126932.984208:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126932.984220:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.984242:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126932.984259:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.984271:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.984290:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:0.0:1789126932.984293:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789126932.984299:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.984306:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb07c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126932.984320:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126932.984322:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126932.984324:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126933.930885:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126934.187100:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789126934.187126:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276773632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126934.187203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126934.187269:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276773760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126934.187269:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276774144:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126934.187322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.187346:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276774656:0@lo:400:kworker.0 00000100:00100000:1.0:1789126934.187350:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276774272:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126934.187377:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276773888:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187391:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276775168:0@lo:400:kworker.0 00000100:00100000:1.0:1789126934.187403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.187411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126934.187425:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276774400:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187429:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789126934.187434:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276774016:0@lo:400:kworker.0 00000100:00100000:1.0:1789126934.187447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.187452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.187467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276774528:0@lo:400:kworker.0 00000100:00100000:1.0:1789126934.187471:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276774912:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126934.187489:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.187507:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276775040:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126934.187547:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276773888 00000100:00100000:0.0:1789126934.187550:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774144 00000100:00100000:2.0:1789126934.187554:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276773888 00000100:00100000:0.0:1789126934.187554:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774144 00000100:00100000:2.0:1789126934.187591:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789126934.187600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774400 00000100:00100000:2.0:1789126934.187601:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276773888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774400 00000100:00100000:0.0:1789126934.187618:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789126934.187630:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276774144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.187681:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276773888:12345-0@lo:400:kworker.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.187689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789126934.187690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276774144:12345-0@lo:400:kworker.0 Request processed in 67us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.187695:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789126934.187709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789126934.187714:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276774400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.187718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774656 00000100:00100000:2.0:1789126934.187726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774656 00000100:00100000:0.0:1789126934.187741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276774400:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.187747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789126934.187755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276775168 00000100:00100000:2.0:1789126934.187757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276775168 00000100:00100000:0.0:1789126934.187762:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774016 00000100:00100000:0.0:1789126934.187764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774016 00000100:00100000:2.0:1789126934.187770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774528 00000100:00100000:2.0:1789126934.187771:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774528 00000100:00100000:0.0:1789126934.187776:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276775040 00000100:00100000:0.0:1789126934.187778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276775040 00000100:00100000:2.0:1789126934.187784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789126934.187790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276774656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.187791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789126934.187796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276775168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.187819:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276774656:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.187819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276775168:12345-0@lo:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.187825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789126934.187893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789126934.187907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789126934.187913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276774016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.187944:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276774016:12345-0@lo:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.187950:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789126934.187961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789126934.187968:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188007:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276774528:12345-0@lo:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.188013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789126934.188024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789126934.188031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276775040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276775040:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.188063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:2.0:1789126934.188096:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789126934.188100:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126934.188141:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276773888:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188153:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276774400:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.188205:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276774016:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188215:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276774528:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188222:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276774784:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276775040:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188240:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276774144:0@lo:400:kworker.0 00010000:00080000:0.0:1789126934.188252:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041ec780 x1876035276774656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126934.188255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.188262:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276774656:0@lo:400:kworker.0 00010000:00080000:0.0:1789126934.188271:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041eed00 x1876035276775168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126934.188273:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276775296:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188279:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276775168:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126934.188315:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774912 00000100:00100000:0.0:1789126934.188319:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774912 00000100:00100000:0.0:1789126934.188350:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774784 00000100:00100000:0.0:1789126934.188353:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774784 00000100:00100000:0.0:1789126934.188366:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276775296 00000100:00100000:0.0:1789126934.188369:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276775296 00000100:00100000:0.0:1789126934.188382:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789126934.188388:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276774912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188397:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789126934.188403:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276774784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188426:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276774912:12345-0@lo:400:kworker.0 Request processed in 37us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.188431:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276774784:12345-0@lo:400:kworker.0 Request processed in 29us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.188432:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789126934.188437:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789126934.188444:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789126934.188450:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104962940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276775296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789126934.188455:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789126934.188458:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126934.188474:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276774912:0@lo:400:kworker.0 00000100:00100000:0.0:1789126934.188474:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104962940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276775296:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.188480:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789126934.188493:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276774784:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188502:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276775296:0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276774272 00000100:00100000:2.0:1789126934.188518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276774272 00000100:00100000:2.0:1789126934.188548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789126934.188554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276774272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126934.188590:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276774272:12345-0@lo:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.188596:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789126934.188628:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276774272:0@lo:400:kworker.0 00000100:00100000:3.0:1789126934.190908:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276773632 00000100:00100000:3.0:1789126934.190997:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276773632 00000100:00100000:1.0:1789126934.191851:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276773760 00000100:00100000:1.0:1789126934.191858:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276773760 00000100:00100000:1.0:1789126934.191906:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789126934.191915:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276773760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126934.193244:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789126934.193481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276773760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1494us (6103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126934.193493:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789126934.194177:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789126934.194189:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276773632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126934.194211:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789126934.194258:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276773632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.194264:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789126934.194316:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276773632:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789126934.194567:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126934.195393:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276773760:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789126934.632017:0:14944:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126934.632027:0:14944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789126934.632068:0:14944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789126934.632075:0:14944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789126934.750731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126934.750814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258865408 00000100:00100000:3.0:1789126934.750823:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258865408 00000100:00100000:3.0:1789126934.750889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:3.0:1789126934.750899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104962580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:11563:x1876035258865408:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126934.750920:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126934.750940:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c481 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.751064:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eb08a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.751077:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eb08a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.751089:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eb08a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126934.751099:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000100:00080000:2.0:1789126934.751191:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789126934.751305:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c481 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.751322:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eb08a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c481 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.751331:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126934.751333:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126934.751337:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:3.0:1789126934.751426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104962580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:11563:x1876035258865408:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 528us (704us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789126934.751434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000040:00080000:3.0:1789126934.768754:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789126934.770140:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126934.770175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258865536 00000100:00100000:2.0:1789126934.770184:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258865536 00000100:00100000:2.0:1789126934.770235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:2.0:1789126934.770246:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104963840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:11563:x1876035258865536:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1789126934.770320:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770338:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770351:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770366:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770396:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770467:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770475:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770482:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126934.770525:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770538:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770545:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770552:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770558:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126934.770563:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770571:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770582:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126934.770592:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126934.770597:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770604:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb098 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770617:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770623:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770629:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770634:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126934.770637:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770643:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770684:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994103ea9400) 00010000:00010000:2.0:1789126934.770687:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126934.770690:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770696:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb09f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770711:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770724:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770730:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770735:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126934.770739:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770746:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770754:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126934.770757:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126934.770760:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.770766:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb0a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126934.770836:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104963840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:11563:x1876035258865536:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 591us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.770845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:0.0:1789126934.806360:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126934.806546:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258865792 00000100:00100000:3.0:1789126934.806563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258865792 00000100:00100000:3.0:1789126934.806683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:3.0:1789126934.806698:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:11566:x1876035258865792:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126934.806752:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126934.806784:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb0ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c488 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.806956:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.806975:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807071:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807079:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807086:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807308:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807317:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807324:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126934.807336:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789126934.807445:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807454:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807461:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807468:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126934.807473:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807482:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807496:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126934.807500:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126934.807505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807513:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb0b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807528:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807535:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807541:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807547:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126934.807557:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807564:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807572:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994236490500) 00010000:00010000:3.0:1789126934.807575:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126934.807578:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807585:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb0bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807638:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb0ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807776:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.807785:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126934.807788:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126934.807790:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216dc00, rc 0) 00000100:00100000:3.0:1789126934.807948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11566:x1876035258865792:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1253us (1610us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789126934.807958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:2.0:1789126934.811691:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.811798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258865920 00000100:00100000:0.0:1789126934.811807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258865920 00000100:00100000:0.0:1789126934.811861:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:0.0:1789126934.811870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11566:x1876035258865920:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1789126934.811932:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.811948:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812410:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812447:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812454:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812461:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812467:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126934.812471:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812478:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812488:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126934.812491:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789126934.812507:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.812514:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb0d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126934.812586:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11566:x1876035258865920:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 717us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.812594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:2.0:1789126934.814581:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126934.814908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258866176 00000100:00100000:1.0:1789126934.814921:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258866176 00000100:00100000:1.0:1789126934.815000:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1789126934.815012:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212265850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11566:x1876035258866176:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126934.815431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212265850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:11566:x1876035258866176:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 421us (866us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789126934.815442:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1789126934.842295:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126934.842405:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258866432 00000100:00100000:2.0:1789126934.842419:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258866432 00000100:00100000:2.0:1789126934.842494:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:2.0:1789126934.842507:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:11083:x1876035258866432:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126934.842561:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126934.842590:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb0d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c48f expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.842868:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.842885:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.842894:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.842938:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.842964:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 24 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126934.842992:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276775424:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126934.846611:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789126934.848916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.849284:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276775424:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126934.849318:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126934.849555:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258866560 00000100:00100000:2.0:1789126934.849564:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258866560 00010000:00010000:2.0:1789126934.849616:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 25 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126934.849700:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1789126934.849712:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:2394:x1876035258866560:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126934.849732:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126934.849760:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 25 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849774:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 25 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849803:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb0c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c488 expref: 25 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849821:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:2.0:1789126934.849826:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849836:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849845:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.849874:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126934.849955:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:2394:x1876035258866560:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 244us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.849965:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00010000:00010000:3.0:1789126934.850248:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.850269:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126934.850294:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789126934.850529:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb0d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 25 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.850558:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.850566:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126934.850569:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126934.850572:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:3.0:1789126934.850871:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236626d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:11083:x1876035258866432:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8366us (8589us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789126934.850880:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:3.0:1789126934.853197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.853298:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258866688 00000100:00100000:0.0:1789126934.853309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258866688 00000100:00100000:0.0:1789126934.853381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:0.0:1789126934.853393:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:11083:x1876035258866688:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789126934.853433:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126934.853459:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb0ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c496 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853503:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eb0f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853521:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eb0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853535:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eb0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853750:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb0ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c496 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853782:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eb0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c496 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.853791:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126934.853795:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789126934.853799:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca000, rc 0) 00000100:00100000:0.0:1789126934.853869:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:11083:x1876035258866688:12345-192.168.203.23@tcp:101:bash.0 Request processed in 478us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.853877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:2.0:1789126934.857433:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126934.857543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258866944 00000100:00100000:3.0:1789126934.857555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258866944 00000100:00100000:3.0:1789126934.857693:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1789126934.857705:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:11083:x1876035258866944:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:3.0:1789126934.858317:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.858338:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.858352:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126934.858416:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789126934.858438:0:6512:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007712d7e1 reply state 00000000e958bcae transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.858452:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.858460:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126934.858463:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126934.858467:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789126934.858505:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789126934.858635:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:11083:x1876035258866944:12345-192.168.203.23@tcp:36:bash.0 Request processed in 929us (1209us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789126934.858643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000020:00080000:3.0:1789126934.858674:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789126934.861433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.861596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867072 00000100:00100000:0.0:1789126934.861609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867072 00000100:00100000:1.0:1789126934.861898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:1.0:1789126934.861912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:11083:x1876035258867072:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1789126934.861942:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126934.861998:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb101 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c49d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.862076:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb101 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c49d expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.862092:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb101 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c49d expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.862126:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126934.862131:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126934.862135:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397e00, rc 0) 00000100:00100000:1.0:1789126934.862216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11083:x1876035258867072:12345-192.168.203.23@tcp:101:bash.0 Request processed in 307us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126934.862225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:1.0:1789126934.865420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126934.865608:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867200 00000100:00100000:2.0:1789126934.865620:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867200 00000100:00080000:1.0:1789126934.865694:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126934.865789:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789126934.865802:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:11083:x1876035258867200:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126934.865829:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126934.865945:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4a4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126934.866038:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3e913, atime: 0x6aa3e912, ctime: 0x6aa3e913, blocks: 0x8 00010000:00010000:2.0:1789126934.866068:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1789126934.866073:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126934.866084:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.866172:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.866190:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:2.0:1789126934.866267:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:11083:x1876035258867200:12345-192.168.203.23@tcp:101:bash.0 Request processed in 468us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126934.866276:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1789126934.868690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126934.868780:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867328 00000100:00100000:1.0:1789126934.868792:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867328 00002000:00010000:1.0:1789126934.868911:0:8433:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789126934.868916:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941041ec780 with x1876035258867328 ext(0->18446744073709551615) 00002000:00010000:1.0:1789126934.868931:0:8433:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941041ec780. 00000100:00100000:1.0:1789126934.868975:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1789126934.868996:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258867328:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:1.0:1789126934.869511:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789126934.869516:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789126931 -> 1789126934 00002000:00010000:1.0:1789126934.869518:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789126930 -> 1789126930 00002000:00010000:1.0:1789126934.869526:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789126931 -> 1789126934 00002000:00010000:1.0:1789126934.869529:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789126934.869711:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2392:x1876035258867328:12345-192.168.203.23@tcp:10:bash.0 Request processed in 725us (1068us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789126934.869721:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00010000:1.0:1789126934.869726:0:8433:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789126934.869729:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941041ec780 with x1876035258867328 ext(0->18446744073709551615) 00002000:00010000:1.0:1789126934.869734:0:8433:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941041ec780. 00000100:00100000:1.0:1789126934.935876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.936541:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867456 00000100:00100000:0.0:1789126934.936558:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867456 00000100:00100000:0.0:1789126934.936739:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:0.0:1789126934.936752:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11580:x1876035258867456:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1789126934.936864:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.936886:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.936901:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.936923:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.936952:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.936959:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937067:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937077:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937085:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126934.937154:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937167:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937174:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937183:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937189:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126934.937193:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937201:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937223:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126934.937226:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126934.937231:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937238:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb10f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937255:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937260:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937265:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937270:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126934.937272:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937277:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937283:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:0.0:1789126934.937285:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126934.937288:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937293:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937318:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937323:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937330:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937334:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126934.937337:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937342:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937348:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126934.937350:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126934.937352:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126934.937357:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb11d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126934.937462:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11580:x1876035258867456:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 712us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126934.937471:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00010000:00010000:3.0:1789126934.955497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126934.976903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126934.977258:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867712 00000100:00100000:2.0:1789126934.977273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867712 00000100:00100000:2.0:1789126934.977353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:2.0:1789126934.977366:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:11583:x1876035258867712:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126934.977395:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126934.977425:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb124 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977521:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977565:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977581:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977599:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977607:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977614:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977904:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb139 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977916:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.977925:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126934.977936:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789126934.978061:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978070:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978077:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978090:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126934.978096:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978452:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978472:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126934.978475:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126934.978482:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978489:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb12b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978506:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978512:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978517:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978522:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126934.978526:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978533:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978552:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994103ea9d00) 00010000:00010000:2.0:1789126934.978555:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126934.978558:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978563:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb132 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978615:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb124 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ab expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978630:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ab expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126934.978636:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:2.0:1789126934.978639:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789126934.978641:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126934.978824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11583:x1876035258867712:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1460us (1940us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789126934.978833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:2.0:1789126934.982251:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126934.982339:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258867840 00000100:00100000:3.0:1789126934.982352:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258867840 00000100:00100000:3.0:1789126934.982426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:3.0:1789126934.982444:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11583:x1876035258867840:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126934.982533:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.982552:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 32 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.982561:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.982612:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 32 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.982626:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 32 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126934.982642:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276775552:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126934.982943:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789126934.986324:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276775552:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126934.986346:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1789126934.986372:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126934.986426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258868096 00000100:00100000:1.0:1789126934.986435:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258868096 00000100:00100000:1.0:1789126934.986561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126934.986572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:6158:x1876035258868096:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789126934.987027:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:6158:x1876035258868096:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 454us (679us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789126934.987037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126934.989500:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126934.989726:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258868224 00000100:00100000:3.0:1789126934.989737:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258868224 00010000:00010000:3.0:1789126934.989785:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 34 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126934.989883:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1789126934.989897:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:2393:x1876035258868224:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126934.989915:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126934.989923:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 34 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.989937:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 34 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.990008:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb0de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c48f expref: 34 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.990152:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126934.990159:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.990169:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.990176:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126934.990210:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126934.990265:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:2393:x1876035258868224:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 372us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126934.990271:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00010000:00010000:1.0:1789126934.990456:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990463:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990504:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990509:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990527:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990531:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126934.990535:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990542:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990549:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126934.990551:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789126934.990554:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126934.990559:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126934.990619:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11583:x1876035258867840:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 8179us (8383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126934.990631:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:1.0:1789126934.994632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126934.994875:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258868480 00000100:00100000:0.0:1789126934.994887:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258868480 00000100:00100000:0.0:1789126934.994965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789126934.995005:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:11583:x1876035258868480:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789126934.995410:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:11583:x1876035258868480:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 407us (792us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789126934.995419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000040:00080000:2.0:1789126935.020613:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126935.020623:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126935.020643:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789126935.020805:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789126935.061749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.061904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258868736 00000100:00100000:1.0:1789126935.061917:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258868736 00000100:00100000:1.0:1789126935.062009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:1.0:1789126935.062021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:11594:x1876035258868736:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:1.0:1789126935.062052:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126935.062079:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb14e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4b2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062206:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062238:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062255:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062263:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062270:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062420:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb163 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062432:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062439:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126935.062451:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789126935.062853:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062863:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062974:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.062991:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.062996:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063006:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063020:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126935.063024:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126935.063030:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063036:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb155 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063051:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063057:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063063:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063068:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.063071:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063087:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063096:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9942139b7800) 00010000:00010000:1.0:1789126935.063099:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126935.063102:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063107:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb15c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063173:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb14e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b2 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063190:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb163 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b2 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.063198:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126935.063200:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126935.063203:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396800, rc 0) 00000100:00100000:1.0:1789126935.063294:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11594:x1876035258868736:12345-192.168.203.23@tcp:101:cat.0 Request processed in 1275us (1561us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789126935.063304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:2.0:1789126935.071173:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.071321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258868992 00000100:00100000:0.0:1789126935.071335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258868992 00000100:00100000:0.0:1789126935.071407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789126935.071419:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:11594:x1876035258868992:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:0.0:1789126935.071848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:11594:x1876035258868992:12345-192.168.203.23@tcp:35:cat.0 Request processed in 430us (688us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789126935.071858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1789126935.095906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.096024:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258869248 00000100:00100000:0.0:1789126935.096039:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258869248 00000100:00100000:0.0:1789126935.096110:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:0.0:1789126935.096122:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:11595:x1876035258869248:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:0.0:1789126935.096196:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789126935.096230:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb101 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c49d expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096258:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb163 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b2 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096272:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb139 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ab expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096309:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666eb0f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c496 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096322:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126935.096328:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126935.096354:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096370:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096381:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096396:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096403:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096410:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096518:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096527:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096534:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789126935.096857:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789126935.096870:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360301220248ns, next at 361301217581ns, rc = 0 00010000:00010000:0.0:1789126935.096948:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096957:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096966:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096975:0:9524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.096996:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097002:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097031:0:9524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789126935.097056:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097062:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097069:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097076:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126935.097086:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097096:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097104:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126935.097107:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126935.097112:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789126935.097114:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097117:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097133:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126935.097135:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eb17f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097139:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097151:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097157:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097166:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097182:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097187:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126935.097188:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126935.097193:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097194:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789126935.097199:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097204:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097210:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb186 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097215:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126935.097220:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126935.097225:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126935.097228:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126935.097230:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.097231:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126935.097239:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666eb171 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126935.097251:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008fa64969 reply state 000000004965e453 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097263:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.097269:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:0.0:1789126935.097272:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789126935.097275:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789126935.097372:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:11595:x1876035258869248:12345-192.168.203.23@tcp:36:rm.0 Request processed in 1249us (1477us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789126935.097382:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:3.0:1789126935.132094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.135313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258869504 00000100:00100000:2.0:1789126935.135360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258869504 00000100:00100000:2.0:1789126935.135462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:2.0:1789126935.135475:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410402b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:11601:x1876035258869504:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126935.135510:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126935.135540:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb18d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4b9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135928:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135945:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135958:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135969:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135976:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.135993:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789126935.136479:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789126935.137079:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137150:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137180:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137221:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137227:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137231:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137235:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126935.137238:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137243:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137254:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126935.137256:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126935.137260:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137264:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb194 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126935.137276:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c139031d reply state 0000000008f5e21b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137298:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137316:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:2.0:1789126935.137318:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126935.137321:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789126935.137364:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb18d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137380:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.137387:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.137390:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126935.137392:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126935.137604:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410402b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:11601:x1876035258869504:12345-192.168.203.23@tcp:101:bash.0 Request processed in 2130us (5522us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789126935.137614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:2.0:1789126935.141988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.142360:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258869632 00000100:00100000:3.0:1789126935.142374:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258869632 00000100:00100000:3.0:1789126935.142481:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1789126935.142494:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258869632:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126935.142519:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789126935.142934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789126935.143408:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4c0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126935.143448:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789126935.143476:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1789126935.143481:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126935.143495:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.143519:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.143576:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216c800, rc 0) 00000100:00100000:3.0:1789126935.143688:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258869632:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1196us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126935.143696:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1789126935.151350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.154740:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258869760 00000100:00100000:2.0:1789126935.154762:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258869760 00000100:00100000:2.0:1789126935.154933:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:2.0:1789126935.154947:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:11601:x1876035258869760:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126935.154991:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126935.155020:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4c7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.155061:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.155094:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126935.155098:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126935.155104:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.155160:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.155178:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 9 pid: 8429 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.155195:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049612c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276775680:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126935.155340:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789126935.164183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.164295:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258869888 00000100:00100000:1.0:1789126935.164307:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258869888 00010000:00010000:1.0:1789126935.164360:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 10 pid: 8429 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.164438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1789126935.164449:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2394:x1876035258869888:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126935.164468:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126935.164495:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 10 pid: 8429 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.164510:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 10 pid: 8429 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.164556:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126935.164562:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126935.164573:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.164585:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.164634:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.164712:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876035276775808:192.168.203.23@tcp:105: 00000100:00100000:1.0:1789126935.164815:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942012546c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789126935.168295:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003021e0eb/0xa840b4da666eb1b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c0 expref: 10 pid: 8429 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.168458:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049612c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276775680:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126935.168504:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.169709:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:2.0:1789126935.169827:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:11601:x1876035258869760:12345-192.168.203.23@tcp:101:bash.0 Request processed in 14879us (18490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.169860:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:2.0:1789126935.173471:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876035276775808:192.168.203.23@tcp:105: 00010000:00010000:2.0:1789126935.173511:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126935.173621:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258869888:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 9171us (9452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.173636:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1789126935.173806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.175495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258870144 00000100:00100000:2.0:1789126935.175513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258870144 00000100:00100000:2.0:1789126935.176009:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1789126935.176025:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:11601:x1876035258870144:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1789126935.181511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11601:x1876035258870144:12345-192.168.203.23@tcp:35:bash.0 Request processed in 5470us (7687us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789126935.181548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1789126935.297891:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.298403:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258870272 00000100:00100000:0.0:1789126935.298417:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258870272 00000100:00100000:0.0:1789126935.298569:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:0.0:1789126935.298583:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:11617:x1876035258870272:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126935.298616:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126935.298646:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666eb1be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4ce expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.298786:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.298804:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.298837:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126935.298896:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789126935.298901:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126935.298925:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.298958:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666eb1be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ce expref: 40 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.298991:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ce expref: 39 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.299001:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126935.299004:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126935.299008:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167c00, rc 0) 00000100:00100000:0.0:1789126935.299104:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:11617:x1876035258870272:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 524us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.299112:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:1.0:1789126935.302905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.303447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258870528 00000100:00100000:2.0:1789126935.303461:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258870528 00000100:00100000:2.0:1789126935.303586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:2.0:1789126935.303600:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:11617:x1876035258870528:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126935.303627:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126935.303700:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb1cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.303856:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb1d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.303874:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.303910:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126935.303926:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789126935.304390:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb1cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4d5 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.304416:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4d5 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.304426:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.304429:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126935.304433:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3a00, rc 0) 00000100:00100000:2.0:1789126935.304517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:11617:x1876035258870528:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 919us (1627us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789126935.304525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:2.0:1789126935.308760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.308814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.308909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258870784 00000100:00100000:1.0:1789126935.308942:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258870784 00000100:00100000:1.0:1789126935.309036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:1.0:1789126935.309049:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:11617:x1876035258870784:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126935.309081:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126935.309125:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb1e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4dc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.309262:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.309280:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.309298:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126935.309312:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789126935.309445:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb1e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4dc expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.309469:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4dc expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.309479:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126935.309482:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789126935.309486:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396c00, rc 0) 00000100:00100000:1.0:1789126935.309569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:11617:x1876035258870784:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 522us (823us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789126935.309577:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:0.0:1789126935.310176:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258870912 00000100:00100000:0.0:1789126935.310184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258870912 00000100:00100000:0.0:1789126935.310242:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789126935.310252:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:2391:x1876035258870912:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126935.310265:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126935.310285:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb1d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4d5 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.310316:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.310321:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126935.310353:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:2391:x1876035258870912:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 103us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.310361:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789126935.316345:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.316407:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871040 00000100:00100000:0.0:1789126935.316421:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871040 00000100:00100000:0.0:1789126935.316505:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1789126935.316516:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258871040:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:0.0:1789126935.316576:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.316600:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.316609:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126935.316614:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126935.316619:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.316699:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.316716:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 8 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126935.316760:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1876035276775936:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126935.316889:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126935.320414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.320725:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871168 00000100:00100000:3.0:1789126935.320736:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871168 00002000:00100000:3.0:1789126935.320798:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff994104961e00 x1876035258871168/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:426/0 lens 504/0 e 0 to 0 dl 1789126946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126935.320810:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104961e00 with x1876035258871168 ext(0->8) 00010000:00010000:3.0:1789126935.320822:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 9 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.320839:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 9 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126935.320847:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff994104961e00 00000100:00100000:3.0:1789126935.320884:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1789126935.320896:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258871168:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:0.0:1789126935.321752:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1876035276775936:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126935.321782:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.324418:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2394:x1876035258871168:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 3503us (3998us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789126935.324437:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00100000:3.0:1789126935.324488:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff994104961e00 x1876035258871168/t4294967303(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:426/0 lens 504/448 e 0 to 0 dl 1789126946 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126935.324500:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104961e00 with x1876035258871168 ext(0->8) 00010000:00010000:3.0:1789126935.324514:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.324537:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126935.324546:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff994104961e00 00000100:00100000:2.0:1789126935.328091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.328555:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871296 00000100:00100000:3.0:1789126935.328568:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871296 00010000:00010000:3.0:1789126935.328623:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.329350:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1789126935.329369:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2391:x1876035258871296:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126935.329392:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789126935.329415:0:13969:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789126935.329419:0:13969:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789126934 00002000:00010000:3.0:1789126935.329421:0:13969:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789126935 00002000:00010000:3.0:1789126935.329424:0:13969:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789126934 00002000:00010000:3.0:1789126935.329426:0:13969:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789126935.329434:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.329487:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.329519:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666eb1b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4c7 expref: 11 pid: 8430 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.329541:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126935.329545:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126935.329551:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.329561:0:13969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.329601:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126935.329710:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2391:x1876035258871296:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 349us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126935.329719:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00010000:00010000:1.0:1789126935.329805:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329816:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329851:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329861:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329869:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329877:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126935.329882:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329892:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329906:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.329915:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666eb1f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.329991:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258871040:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 13477us (13661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126935.330000:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1789126935.333424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.333624:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871552 00000100:00100000:0.0:1789126935.333636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871552 00000100:00100000:0.0:1789126935.335832:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1789126935.335849:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212264050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:11617:x1876035258871552:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:0.0:1789126935.336432:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4dc expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126935.338015:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789126935.338069:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789126935.338511:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1789126935.338564:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.339174:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.339188:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.339240:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.339272:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 46 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126935.339291:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276776064:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126935.339418:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789126935.346062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.346254:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871680 00000100:00100000:2.0:1789126935.346267:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871680 00010000:00010000:2.0:1789126935.346322:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 47 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.346398:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:2.0:1789126935.346410:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:2393:x1876035258871680:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126935.346430:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126935.346438:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 47 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.346453:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 47 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.346492:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.346498:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.346509:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.346517:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.346542:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126935.346616:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:2393:x1876035258871680:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 208us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.346624:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:1.0:1789126935.348271:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb1a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4b9 expref: 46 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.348297:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276776064:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126935.348328:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.348339:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.348344:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126935.348570:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789126935.349366:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789126935.349525:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276776192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126935.351845:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126935.351957:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70900 going to sleep for 11 seconds 00000100:00100000:0.0:1789126935.353755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276776192 00000100:00100000:0.0:1789126935.353773:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276776192 00000100:00100000:0.0:1789126935.353848:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789126935.353859:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276776192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789126935.354210:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276776192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 351us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.354219:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789126935.354302:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276776192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789126935.356060:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789126935.356352:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276776320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126935.356439:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126935.356507:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126935.356670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276776320 00000100:00100000:2.0:1789126935.356678:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276776320 00000100:00100000:2.0:1789126935.356822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789126935.356844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276776320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789126935.358812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6516:x1876035276776320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1959us (2361us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789126935.358838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789126935.360376:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276776320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789126935.360488:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789126935.360554:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360565:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360586:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360592:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.360598:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360607:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360627:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126935.360630:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789126935.360636:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.360643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb1fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789126935.363347:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789126935.363496:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789126935.363514:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360567865077ns, next at 361567858709ns, rc = 0 00000001:00080000:2.0:1789126935.363530:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789126935.363612:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.363617:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789126935.363634:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb1e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4dc expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.363866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212264050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:11617:x1876035258871552:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 28019us (30454us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789126935.363878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000020:00080000:2.0:1789126935.363885:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789126935.367445:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.370273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258871808 00000100:00100000:2.0:1789126935.370294:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258871808 00000100:00100000:2.0:1789126935.370478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:2.0:1789126935.370493:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:11617:x1876035258871808:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126935.370528:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126935.370558:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb204 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.370644:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb204 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4e3 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.370721:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb204 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4e3 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.370745:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.370749:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789126935.370754:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3200, rc 0) 00000100:00100000:2.0:1789126935.370837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:11617:x1876035258871808:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 347us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.370845:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:1.0:1789126935.378937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.379384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258872064 00000100:00100000:2.0:1789126935.379403:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258872064 00000100:00100000:2.0:1789126935.379544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1789126935.379556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:11617:x1876035258872064:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1789126935.380012:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:11617:x1876035258872064:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 455us (1090us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789126935.380021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789126935.472022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.472191:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258872192 00000100:00100000:1.0:1789126935.472203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258872192 00000100:00100000:1.0:1789126935.472379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1789126935.472395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:11627:x1876035258872192:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:1.0:1789126935.472516:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475175:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475194:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475228:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475237:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475244:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475375:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475390:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789126935.475462:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475479:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475510:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.475518:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.477899:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.477909:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.477921:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.477943:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126935.477947:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126935.477953:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.477961:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb20b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.477993:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478001:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478008:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478013:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.478042:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478049:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478058:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:1.0:1789126935.478060:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126935.478063:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478069:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb212 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478082:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478087:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478093:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478098:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126935.478102:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478107:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478115:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126935.478117:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126935.478126:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.478133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126935.479168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:11627:x1876035258872192:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 6764us (7147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.479183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1789126935.509111:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.509297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258872448 00000100:00100000:3.0:1789126935.509311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258872448 00000100:00100000:3.0:1789126935.509395:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:3.0:1789126935.509407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:11630:x1876035258872448:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126935.509435:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126935.509463:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb220 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509587:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509607:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509622:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509637:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509645:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509704:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509855:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509864:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.509871:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126935.509882:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789126935.509992:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510095:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510110:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510116:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126935.510122:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510130:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510144:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126935.510147:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126935.510153:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510160:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb227 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510176:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510183:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510189:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510195:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216c800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126935.510199:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510215:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510224:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:3.0:1789126935.510226:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126935.510230:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510236:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb22e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510282:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb220 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510296:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.510303:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.510305:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126935.510308:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216ca00, rc 0) 00000100:00100000:3.0:1789126935.510384:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11630:x1876035258872448:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 979us (1289us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789126935.510392:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:1.0:1789126935.519157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.519276:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258872576 00000100:00100000:0.0:1789126935.519289:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258872576 00000100:00100000:0.0:1789126935.519373:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:0.0:1789126935.519384:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11630:x1876035258872576:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1789126935.519478:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519537:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519552:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519598:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519606:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519614:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519620:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126935.519625:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519634:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519676:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.519681:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789126935.519687:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.519694:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb243 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126935.520066:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11630:x1876035258872576:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 682us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.520082:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:0.0:1789126935.525783:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.526227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258872832 00000100:00100000:1.0:1789126935.526241:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258872832 00000100:00100000:1.0:1789126935.526404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1789126935.526417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:11630:x1876035258872832:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126935.526764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11630:x1876035258872832:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 349us (994us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789126935.526774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1789126935.600712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.600924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873088 00000100:00100000:2.0:1789126935.600937:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873088 00000100:00100000:2.0:1789126935.601096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1789126935.601109:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11640:x1876035258873088:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126935.601141:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126935.601145:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789126935.601181:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb1c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ce expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601229:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126935.601235:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126935.601254:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb24a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601409:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601425:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601439:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601555:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.601572:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 54 pid: 6514 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.601590:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104962d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276776448:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126935.601813:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45240 going to sleep for 11 seconds 00000100:00100000:1.0:1789126935.606780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126935.606877:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873216 00000100:00100000:2.0:1789126935.606890:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873216 00010000:00010000:2.0:1789126935.606951:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 55 pid: 6514 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.607042:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:2.0:1789126935.607054:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:2393:x1876035258873216:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126935.607073:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126935.607081:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 55 pid: 6514 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.607096:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 55 pid: 6514 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.607123:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126935.607129:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.607140:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.607149:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.607174:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126935.607245:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:2393:x1876035258873216:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 193us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.607254:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00010000:00010000:0.0:1789126935.608759:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ea expref: 54 pid: 6514 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126935.608790:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104962d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276776448:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126935.608819:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.609451:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.609460:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126935.609486:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789126935.610268:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb24a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.610291:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.610301:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.610304:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789126935.610307:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:0.0:1789126935.610392:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11640:x1876035258873088:12345-192.168.203.23@tcp:101:bash.0 Request processed in 9285us (9742us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789126935.610401:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:1.0:1789126935.613594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.613780:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873344 00000100:00100000:0.0:1789126935.613791:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873344 00000100:00100000:0.0:1789126935.613920:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:0.0:1789126935.613933:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:11640:x1876035258873344:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789126935.613963:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126935.614000:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb25f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4f8 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614054:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614070:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614084:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614381:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb25f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 56 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614403:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.614412:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.614415:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789126935.614420:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167800, rc 0) 00000100:00100000:0.0:1789126935.614503:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:11640:x1876035258873344:12345-192.168.203.23@tcp:101:bash.0 Request processed in 573us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.614511:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:2.0:1789126935.619099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.619261:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873600 00000100:00100000:3.0:1789126935.619273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873600 00000100:00100000:3.0:1789126935.619365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:3.0:1789126935.619377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:11640:x1876035258873600:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:3.0:1789126935.619695:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.619715:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.619729:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126935.619772:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789126935.619793:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000005caedff reply state 000000000dc196e4 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.619806:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.619813:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.619817:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126935.619821:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126935.619932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11640:x1876035258873600:12345-192.168.203.23@tcp:36:bash.0 Request processed in 556us (845us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789126935.619940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000020:00080000:3.0:1789126935.619946:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789126935.624268:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.624399:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873728 00000100:00100000:3.0:1789126935.624412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873728 00000100:00100000:3.0:1789126935.624843:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:3.0:1789126935.624858:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11640:x1876035258873728:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126935.624890:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126935.624929:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb274 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c4ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.625093:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.625111:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.625122:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.625163:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.625177:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 59 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.625193:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276776576:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126935.625298:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789126935.627818:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276776576:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126935.627869:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.629570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.629808:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258873856 00000100:00100000:3.0:1789126935.629817:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258873856 00010000:00010000:3.0:1789126935.629867:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 60 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.629920:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:3.0:1789126935.629956:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:2393:x1876035258873856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126935.629975:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126935.629993:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 60 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630008:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 60 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630037:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb251 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f1 expref: 60 pid: 6513 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630058:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.630063:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630076:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630084:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.630710:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126935.630788:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:2393:x1876035258873856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 831us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126935.630797:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00010000:00010000:0.0:1789126935.631572:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.631585:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126935.631763:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789126935.631769:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126935.631797:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.631842:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.631864:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.631874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.631876:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126935.631880:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d600, rc 0) 00000100:00100000:0.0:1789126935.631990:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11640:x1876035258873728:12345-192.168.203.23@tcp:101:bash.0 Request processed in 7136us (7735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.631999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:1.0:1789126935.636218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.636639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874112 00000100:00100000:0.0:1789126935.636683:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874112 00000100:00100000:0.0:1789126935.636749:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1789126935.636761:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:11640:x1876035258874112:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:0.0:1789126935.637164:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11640:x1876035258874112:12345-192.168.203.23@tcp:35:bash.0 Request processed in 403us (958us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789126935.637196:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:1.0:1789126935.704161:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.704303:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874240 00000100:00100000:0.0:1789126935.704317:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874240 00000100:00100000:0.0:1789126935.704397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:0.0:1789126935.704410:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:11646:x1876035258874240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126935.704443:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126935.704473:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c506 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.704560:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.704578:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.704591:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126935.704804:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789126935.704809:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126935.704929:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.704960:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c506 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.704992:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c506 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.705022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126935.705026:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789126935.705030:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167e00, rc 0) 00000100:00100000:1.0:1789126935.705147:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258874240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 739us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126935.705156:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1789126935.711476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126935.711835:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874368 00000100:00100000:0.0:1789126935.711848:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874368 00000100:00100000:0.0:1789126935.711930:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:0.0:1789126935.711943:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258874368:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126935.711985:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126935.712013:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb290 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c50d expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712297:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712322:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712340:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712441:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712450:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.712457:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713071:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713084:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713092:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126935.713147:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789126935.713152:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126935.713174:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713204:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713281:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713290:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713298:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713305:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126935.713310:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713318:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713332:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:0.0:1789126935.713336:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126935.713341:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713348:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb297 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713362:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713369:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713381:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713387:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126935.713390:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713396:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713404:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:0.0:1789126935.713407:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126935.713410:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713416:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eb29e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713455:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb290 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713471:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126935.713479:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126935.713482:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126935.713485:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166600, rc 0) 00000100:00100000:0.0:1789126935.713773:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11646:x1876035258874368:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1830us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126935.713792:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:0.0:1789126935.718773:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.718878:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874624 00000100:00100000:3.0:1789126935.718892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874624 00000100:00100000:3.0:1789126935.718960:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:3.0:1789126935.718971:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11646:x1876035258874624:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126935.719034:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126935.719070:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c514 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719516:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719592:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719603:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719612:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719679:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.719694:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.719710:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276776704:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126935.722715:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.722757:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.722759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.722802:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103076580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276776832:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126935.722932:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a600 going to sleep for 11 seconds 00010000:00010000:3.0:1789126935.722967:0:6514:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.23@tcp) returned -22 from blocking AST (req@0000000013c71dc6 x1876035276776704) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.722995:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.723025:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb2a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c50d expref: 62 pid: 9524 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126935.723044:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276776704:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126935.723212:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874752 00000100:00100000:0.0:1789126935.723221:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874752 00000100:00100000:0.0:1789126935.723338:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1789126935.723354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:2391:x1876035258874752:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126935.723380:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126935.723384:0:6498:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a840b4da666eb2a5) 00010000:00010000:0.0:1789126935.723386:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126935.723416:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:2391:x1876035258874752:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 65us (658us total) trans 0 rc 116/116 00000100:00100000:0.0:1789126935.723424:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1789126935.728427:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103076580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276776832:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126935.728463:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.728471:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126935.728489:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1789126935.728497:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.728512:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.728638:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258874880 00000100:00100000:1.0:1789126935.728678:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258874880 00010000:00010000:1.0:1789126935.728731:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126935.728780:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:1.0:1789126935.728792:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:2393:x1876035258874880:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126935.728811:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126935.728819:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728834:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728861:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb27b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4ff expref: 62 pid: 6512 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728890:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126935.728911:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728924:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728934:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.728969:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126935.729041:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:2393:x1876035258874880:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 251us (566us total) trans 0 rc 0/0 00010000:00010000:3.0:1789126935.729093:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.729124:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126935.729144:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789126935.729257:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.729278:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.729287:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.729291:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126935.729293:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216c800, rc 0) 00000100:00100000:3.0:1789126935.729352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11646:x1876035258874624:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 10382us (10592us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789126935.729361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:1.0:1789126935.730089:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000001:00080000:3.0:1789126935.731192:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789126935.731206:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789126935.747458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.747545:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875136 00000100:00100000:3.0:1789126935.747559:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875136 00000100:00100000:3.0:1789126935.747702:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789126935.747714:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11646:x1876035258875136:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1789126935.747737:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126935.747769:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb204 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4e3 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126935.747791:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126935.747816:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126935.748279:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258875136:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 565us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126935.748290:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1789126935.754456:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126935.754621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875264 00000100:00100000:3.0:1789126935.754635:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875264 00000100:00100000:2.0:1789126935.755110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1789126935.755143:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258875264:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:2.0:1789126935.755302:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.755323:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126935.755337:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789126935.755465:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789126935.755577:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258875264:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 437us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126935.755586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1789126935.765451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126935.765570:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875392 00000100:00100000:1.0:1789126935.765583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875392 00000100:00100000:1.0:1789126935.765701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:1.0:1789126935.765713:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:11646:x1876035258875392:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126935.765742:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126935.765769:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c51b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.765842:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.765856:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.765880:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.765913:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.765930:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126935.765933:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126935.765937:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126935.766129:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396600, rc 0) 00000100:00100000:1.0:1789126935.766207:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11646:x1876035258875392:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 496us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126935.766216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00010000:00010000:0.0:1789126935.978955:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789126936.042935:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126936.042947:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126936.044181:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789126936.044200:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789126936.044450:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276776960:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789126936.044736:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45240 going to sleep for 11 seconds 00000100:00100000:0.0:1789126936.054699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.058204:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875520 00000100:00100000:1.0:1789126936.058224:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875520 00000100:00100000:1.0:1789126936.058362:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1789126936.058378:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258875520:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126936.058419:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126936.058623:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258875520:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 250us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.058633:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00080000:0.0:1789126936.058981:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126936.062572:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276776960:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789126936.074486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.074838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875648 00000100:00100000:3.0:1789126936.074850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875648 00000100:00100000:3.0:1789126936.074921:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:3.0:1789126936.074931:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11647:x1876035258875648:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789126936.075039:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.075299:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.075315:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076090:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076113:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076126:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076160:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076169:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076191:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126936.076242:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789126936.076246:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126936.076260:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076272:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076278:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076285:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076291:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216dc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126936.076295:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076302:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076314:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:3.0:1789126936.076317:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126936.076322:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076328:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb2cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076354:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076360:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076366:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076371:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126936.076374:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076379:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076385:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff994236490200) 00010000:00010000:3.0:1789126936.076388:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126936.076391:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076395:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb2d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076410:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076417:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076422:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076432:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126936.076435:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076441:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076448:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126936.076450:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126936.076453:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.076458:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb2dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.076551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11647:x1876035258875648:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 1617us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.076562:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:0.0:1789126936.078824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.079258:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258875904 00000100:00100000:1.0:1789126936.079273:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258875904 00000100:00100000:1.0:1789126936.079362:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:1.0:1789126936.079374:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:11647:x1876035258875904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.079422:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126936.079450:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb2e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c522 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079598:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079617:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079632:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126936.079646:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789126936.079776:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079784:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079791:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079799:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.079804:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079813:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079829:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126936.079839:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789126936.079846:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079853:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb2eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079906:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb2e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c522 expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079917:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:1.0:1789126936.079920:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789126936.079924:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb2e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c522 expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.079935:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397600, rc 0) 00000100:00100000:1.0:1789126936.080033:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258875904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 661us (1217us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789126936.080042:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:0.0:1789126936.088125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.092434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258876032 00000100:00100000:1.0:1789126936.092449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258876032 00000100:00100000:1.0:1789126936.092524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:1.0:1789126936.092536:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258876032:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126936.092574:0:6513:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126936.092707:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258876032:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 173us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.093307:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:0.0:1789126936.095851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.096030:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258876288 00000100:00100000:1.0:1789126936.096070:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258876288 00000100:00100000:1.0:1789126936.096197:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:1.0:1789126936.096210:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258876288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.096238:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126936.096242:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789126936.096278:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c506 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.096301:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126936.096308:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126936.096324:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb2f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c529 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789126936.096898:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789126936.099720:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb300 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.099744:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb300 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.100041:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb300 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.100148:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb2f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c529 expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.100172:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb300 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c529 expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.100201:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9942139b7800) 00010000:00010000:1.0:1789126936.100204:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126936.100208:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396200, rc 0) 00000100:00100000:1.0:1789126936.100351:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11647:x1876035258876288:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4142us (4511us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789126936.100360:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:0.0:1789126936.110778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.110926:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258876544 00000100:00100000:3.0:1789126936.110938:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258876544 00000100:00100000:3.0:1789126936.111036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:3.0:1789126936.111049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11647:x1876035258876544:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789126936.111184:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126936.111223:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb300 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c529 expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111250:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9942139b7800) 00010000:00010000:3.0:1789126936.111264:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126936.111303:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111322:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111334:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111353:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111360:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111367:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111429:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111436:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111443:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111450:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126936.111455:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111463:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111483:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:3.0:1789126936.111486:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126936.111491:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111497:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb30e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111507:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111514:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111519:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111525:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126936.111528:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111534:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111541:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x28662e1 (ffff994236490200) 00010000:00010000:3.0:1789126936.111544:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126936.111547:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.111552:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb315 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x28662e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.111716:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258876544:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 669us (953us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789126936.111724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:0.0:1789126936.119789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.119921:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258876672 00000100:00100000:3.0:1789126936.119934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258876672 00000100:00100000:3.0:1789126936.120049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:3.0:1789126936.120071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:11647:x1876035258876672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126936.120101:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126936.120131:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb31c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120181:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120196:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120210:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120338:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb31c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120359:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.120368:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:3.0:1789126936.120379:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789126936.120384:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:3.0:1789126936.120463:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11647:x1876035258876672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 395us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.120472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:0.0:1789126936.126891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.126995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258876928 00000100:00100000:3.0:1789126936.127008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258876928 00000100:00100000:3.0:1789126936.127202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:3.0:1789126936.127216:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:11647:x1876035258876928:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789126936.127331:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.127352:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.127366:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789126936.127577:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789126936.127588:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361331939019ns, next at 362331936027ns, rc = 0 00000004:00010000:3.0:1789126936.127689:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000121277d reply state 000000002b64fe1f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.127705:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.127713:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:3.0:1789126936.127716:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789126936.127721:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126936.127852:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11647:x1876035258876928:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 638us (977us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789126936.127878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:0.0:1789126936.149806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.149918:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877056 00000100:00100000:1.0:1789126936.149932:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877056 00000100:00100000:1.0:1789126936.150022:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:1.0:1789126936.150035:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:11647:x1876035258877056:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.150067:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126936.150096:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c537 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.150186:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.150203:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.150225:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.150229:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126936.150234:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397600, rc 0) 00000100:00100000:1.0:1789126936.150311:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11647:x1876035258877056:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 278us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.150341:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:0.0:1789126936.155916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.156046:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877184 00000100:00100000:2.0:1789126936.156059:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877184 00000100:00100000:2.0:1789126936.156168:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1789126936.156181:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258877184:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789126936.156475:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258877184:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 296us (575us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789126936.156505:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00080000:0.0:1789126936.157573:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126936.186612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.189254:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877440 00000100:00100000:2.0:1789126936.189276:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877440 00000100:00100000:2.0:1789126936.189382:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:2.0:1789126936.189395:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:11647:x1876035258877440:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789126936.189761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:11647:x1876035258877440:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 367us (3162us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789126936.189770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1789126936.222670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.223818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877696 00000100:00100000:3.0:1789126936.223835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877696 00000100:00100000:3.0:1789126936.223929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:3.0:1789126936.223941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:11647:x1876035258877696:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789126936.224169:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:11647:x1876035258877696:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 230us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.224179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1789126936.229820:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.232203:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877824 00000100:00100000:1.0:1789126936.232226:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877824 00000100:00100000:1.0:1789126936.232339:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1789126936.232353:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:11647:x1876035258877824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.232393:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126936.232424:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb338 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c53e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232531:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232557:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232571:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126936.232639:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126936.232697:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232733:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb338 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c53e expref: 69 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232759:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c53e expref: 68 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.232799:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.232802:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789126936.232807:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396800, rc 0) 00000100:00100000:1.0:1789126936.232926:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:11647:x1876035258877824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 575us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.232935:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:3.0:1789126936.236143:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276777088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126936.236249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126936.236587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276777088 00000100:00100000:0.0:1789126936.236598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276777088 00000100:00100000:0.0:1789126936.237019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789126936.237033:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276777088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126936.237087:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126936.237175:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276777088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.237184:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789126936.237306:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276777088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126936.242367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.242632:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258877952 00000100:00100000:3.0:1789126936.242645:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258877952 00000100:00100000:3.0:1789126936.242744:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1789126936.242756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258877952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126936.242782:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126936.242813:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c545 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126936.242858:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3e917, blocks: 0x0 00010000:00010000:3.0:1789126936.242887:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1789126936.242893:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126936.242905:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.242927:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.242963:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216dc00, rc 0) 00000100:00100000:3.0:1789126936.243052:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2394:x1876035258877952:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 298us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.243060:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1789126936.250400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.250468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878208 00000100:00100000:1.0:1789126936.250480:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878208 00000100:00100000:1.0:1789126936.250551:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:1.0:1789126936.250563:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:11647:x1876035258878208:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789126936.250738:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:11647:x1876035258878208:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 177us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.250747:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:0.0:1789126936.253698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.259489:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878336 00000100:00100000:2.0:1789126936.259579:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878336 00000100:00100000:2.0:1789126936.259811:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1789126936.259828:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:11647:x1876035258878336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126936.259855:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126936.259880:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c54c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.259924:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.259935:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126936.259941:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126936.259947:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.260034:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.260051:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.260068:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276777216:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126936.260241:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.264581:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276777216:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126936.264639:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.264696:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3a00, rc 0) 00000100:00100000:2.0:1789126936.264785:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:11647:x1876035258878336:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4961us (11146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126936.264796:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1789126936.265410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.265621:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878464 00000100:00100000:1.0:1789126936.265632:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878464 00010000:00010000:1.0:1789126936.265722:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.265767:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:1.0:1789126936.265778:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2393:x1876035258878464:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126936.265797:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126936.265824:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.265864:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.265896:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011252344/0xa840b4da666eb346 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c545 expref: 11 pid: 8429 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.265916:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126936.265922:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126936.265933:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.265946:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.266002:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.266019:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049ce940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876035276777344:192.168.203.23@tcp:105: 00000100:00100000:1.0:1789126936.266123:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d70d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789126936.272572:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.272699:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878592 00000100:00100000:2.0:1789126936.272711:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878592 00002000:00100000:2.0:1789126936.272774:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff994103077840 x1876035258878592/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:427/0 lens 504/0 e 0 to 0 dl 1789126947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126936.272787:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994103077840 with x1876035258878592 ext(0->12) 00002000:00010000:2.0:1789126936.272796:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994103077840 00000100:00100000:2.0:1789126936.272842:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1789126936.272871:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2393:x1876035258878592:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789126936.275208:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049ce940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876035276777344:192.168.203.23@tcp:105: 00010000:00010000:1.0:1789126936.275242:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126936.275443:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2393:x1876035258878464:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 9664us (10034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.275457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:2.0:1789126936.279442:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:2393:x1876035258878592:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 6559us (6872us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789126936.279461:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:2.0:1789126936.279477:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff994103077840 x1876035258878592/t4294967309(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:427/0 lens 504/448 e 0 to 0 dl 1789126947 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126936.279488:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994103077840 with x1876035258878592 ext(0->12) 00002000:00010000:2.0:1789126936.279496:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994103077840 00000100:00100000:3.0:1789126936.285887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.286676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878720 00000100:00100000:2.0:1789126936.286692:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878720 00000100:00100000:2.0:1789126936.286784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:2.0:1789126936.286797:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:11647:x1876035258878720:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789126936.297012:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789126936.297035:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789126936.297084:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789126936.297121:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9941043340c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789126936.297125:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994220016200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994104334540 00000020:00080000:3.0:1789126936.297131:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994220016300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994104324600 00000004:00080000:3.0:1789126936.297160:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789126936.297188:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9942365206c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789126936.297191:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994104117500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994236520780 00000020:00080000:3.0:1789126936.297194:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994104117a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9941042a2200 00000020:00080000:3.0:1789126936.297207:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:1.0:1789126936.297431:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297446:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297456:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297463:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297469:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297478:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297499:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff994103ea5500) 00010000:00010000:1.0:1789126936.297502:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.297509:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297516:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666eb052 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297555:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297562:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297568:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297598:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297602:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297609:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297618:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126936.297621:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.297624:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297630:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb0fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297710:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297717:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297725:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297731:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297734:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297740:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297759:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:1.0:1789126936.297763:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.297766:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297772:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb800/0xa840b4da666eb178 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297786:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297792:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297798:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297803:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297806:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297813:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297833:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994102e04500) 00010000:00010000:1.0:1789126936.297835:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.297839:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297845:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb19b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297871:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297877:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297883:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297889:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297892:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297918:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297927:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126936.297930:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.297933:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297939:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb26d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297951:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297957:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297964:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297985:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ec00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.297988:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.297994:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.298004:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.298006:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789126936.298009:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.298014:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ec00/0xa840b4da666eb32a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789126936.298038:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789126936.298137:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789126936.300455:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276777600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789126936.300520:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11647:x1876035258878720:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 13720us (14644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.300534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:1.0:1789126936.300542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126936.300755:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126936.300765:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276777472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789126936.300836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126936.300883:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276777600 00000100:00100000:1.0:1789126936.300892:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276777600 00000100:00100000:3.0:1789126936.300984:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276777472 00000100:00100000:3.0:1789126936.300990:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276777472 00000100:00100000:3.0:1789126936.301054:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789126936.301074:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276777472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789126936.301118:0:8906:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:1.0:1789126936.301135:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789126936.301145:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276777600:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789126936.301153:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789126936.301162:0:8429:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1789126936.301182:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.301193:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789126936.301199:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00002000:00010000:1.0:1789126936.301199:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3e916, atime: 0x6aa3e917, ctime: 0x6aa3e916, blocks: 0x8 00010000:00010000:3.0:1789126936.301206:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301221:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301234:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789126936.301237:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126936.301245:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.301260:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301279:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.301280:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 11 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301306:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.301310:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276777728:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126936.301323:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301348:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789126936.301369:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126936.301544:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276777600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 401us (1004us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789126936.301552:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789126936.301574:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126936.301582:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301591:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126936.301596:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.301615:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789126936.302080:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126936.302087:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126936.302168:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276777856:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789126936.302195:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.302207:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666eb35b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.302230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789126936.302239:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126936.302243:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126936.302246:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126936.302417:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789126936.302426:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:3.0:1789126936.302456:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104841e00, transno 4294967302 00000004:00080000:3.0:1789126936.302461:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:3.0:1789126936.302482:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9941049621c0 x1876035276777600/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789126952 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789126936.302505:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9941049621c0/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789126936.302511:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941049621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276777600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789126936.303398:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276777856 00000100:00100000:0.0:1789126936.303410:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276777856 00000100:00100000:0.0:1789126936.303462:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789126936.303472:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276777856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789126936.303618:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789126936.303622:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789126935 00002000:00010000:0.0:1789126936.303624:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789126936.303627:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789126935 -> 1789126935 00002000:00010000:0.0:1789126936.303629:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789126936.303712:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1876035276777856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (1497us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789126936.303734:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789126936.303780:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99422fb8fc00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789126936.303786:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276777856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789126936.308534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126936.308580:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.308594:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878976 00000100:00100000:1.0:1789126936.308608:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878976 00010000:00010000:1.0:1789126936.308755:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 12 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.308866:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1789126936.308879:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:2393:x1876035258878976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126936.308917:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126936.308925:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 12 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.308942:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 12 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.309020:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126936.309026:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126936.309033:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.309044:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.309072:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126936.309293:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:2393:x1876035258878976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 415us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.309303:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:2.0:1789126936.309381:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258878848 00000100:00100000:2.0:1789126936.309388:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258878848 00000100:00100000:2.0:1789126936.309425:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1789126936.309433:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:2393:x1876035258878848:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789126936.311401:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789126936.311419:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1789126936.311845:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eb108 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4a4 expref: 7 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.311872:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276777728:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126936.311904:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.311917:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.311926:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.312029:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.312038:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.312066:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789126936.312093:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258878848:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 2658us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.312105:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00010000:00010000:2.0:1789126936.312184:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126936.312194:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.312203:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126936.312208:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.312518:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.312542:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.312551:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a55fa2f/0xa840b4da666eb354 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.312574:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126936.312576:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126936.312578:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126936.317110:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276777472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16021us (16268us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789126936.317129:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789126936.317156:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789126936.317165:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1789126936.317204:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99422fb8fc00, transno 4294967310 00000100:00100000:1.0:1789126936.317231:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99422fb8c780 x1876035276777472/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789126952 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789126936.317245:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99422fb8c780/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789126936.317252:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276777472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789126936.321758:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.321899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258879232 00000100:00100000:1.0:1789126936.321910:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258879232 00000100:00100000:1.0:1789126936.322000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:1.0:1789126936.322013:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11647:x1876035258879232:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.322088:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126936.322126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb33f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c53e expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.322159:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.322166:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126936.322208:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.322349:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.322364:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789126936.322507:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002ac88acb reply state 000000005ed90f13 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.322521:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.322529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.322532:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789126936.322535:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126936.322700:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:11647:x1876035258879232:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 689us (957us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789126936.322709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:1.0:1789126936.328859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.328969:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258879360 00000100:00100000:2.0:1789126936.328990:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258879360 00000100:00100000:2.0:1789126936.329054:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1789126936.329066:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258879360:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789126936.329263:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789126936.329268:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789126935 -> 1789126935 00002000:00010000:2.0:1789126936.329271:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789126935 00002000:00010000:2.0:1789126936.329273:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789126935 -> 1789126935 00002000:00010000:2.0:1789126936.329276:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789126936.329359:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258879360:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 294us (514us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789126936.329367:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1789126936.336007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.336154:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258879616 00000100:00100000:1.0:1789126936.336168:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258879616 00000100:00100000:1.0:1789126936.336248:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:1.0:1789126936.336261:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:11647:x1876035258879616:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789126936.336365:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.336386:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.336396:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.336438:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.336453:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 17 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.336470:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276777984:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126936.336603:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126936.344833:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276777984:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126936.344875:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.348725:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.348871:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258879744 00000100:00100000:3.0:1789126936.348885:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258879744 00010000:00010000:3.0:1789126936.348953:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 18 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.349017:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1789126936.349028:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:2393:x1876035258879744:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126936.349076:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126936.349085:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 18 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349107:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 18 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349136:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f200/0xa840b4da666eb323 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c530 expref: 18 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349157:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:3.0:1789126936.349162:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349173:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349182:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.349218:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126936.349290:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:2393:x1876035258879744:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 262us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.349310:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00010000:00010000:0.0:1789126936.349494:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349503:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349553:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349561:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349569:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349576:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126936.349589:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349600:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349610:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:0.0:1789126936.349613:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789126936.349618:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.349624:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb369 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.349721:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11647:x1876035258879616:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 13463us (13729us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789126936.349731:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:1.0:1789126936.356234:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126936.356331:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258879872 00000100:00100000:0.0:1789126936.356345:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258879872 00000100:00100000:0.0:1789126936.356426:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1789126936.356439:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258879872:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789126936.356505:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.356530:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.356540:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126936.356546:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126936.356572:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.356620:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.356637:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 7 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.356709:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276778112:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126936.356837:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09000 going to sleep for 11 seconds 00000100:00100000:0.0:1789126936.370955:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276778112:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126936.371002:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.376714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126936.377383:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880000 00000100:00100000:0.0:1789126936.377400:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880000 00010000:00010000:0.0:1789126936.377458:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 8 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.377515:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:0.0:1789126936.377528:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258880000:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126936.377547:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126936.377577:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 8 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.377617:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 8 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.377683:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1410a23/0xa840b4da666eb34d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c54c expref: 8 pid: 8428 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.377706:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126936.377712:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126936.377720:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.377731:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.377765:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126936.378315:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378328:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378358:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378383:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378392:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378401:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126936.378406:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378417:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378433:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.378441:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cb4ade6/0xa840b4da666eb370 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.378599:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258880000:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1069us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.378610:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1789126936.379528:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258879872:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 23085us (23304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126936.379540:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1789126936.389297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.389468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880256 00000100:00100000:2.0:1789126936.389490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880256 00000100:00100000:2.0:1789126936.389592:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:2.0:1789126936.389618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:11647:x1876035258880256:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789126936.390039:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.390059:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.390070:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.390116:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.390133:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 16 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.390150:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778240:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126936.392739:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421393c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126936.399517:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778240:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126936.399587:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.401875:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.401988:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880384 00000100:00100000:3.0:1789126936.402000:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880384 00010000:00010000:3.0:1789126936.402101:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.402154:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1789126936.402166:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:2393:x1876035258880384:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126936.402185:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126936.402193:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402207:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402236:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c4f8 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402257:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126936.402264:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402276:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402285:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402314:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.402359:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126936.402448:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:2393:x1876035258880384:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 283us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.402457:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00010000:00010000:2.0:1789126936.402638:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.402700:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.402925:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.402948:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.402959:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.403008:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.403025:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 16 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.403041:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778368:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126936.403115:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420956f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.407481:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.407627:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880512 00000100:00100000:3.0:1789126936.407640:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880512 00010000:00010000:3.0:1789126936.407738:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126936.407778:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:3.0:1789126936.407789:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:2393:x1876035258880512:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126936.407806:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126936.407813:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.407828:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 17 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.407856:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:3.0:1789126936.407863:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.407875:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.407900:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126936.407924:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126936.407993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+17:2393:x1876035258880512:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 205us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126936.408002:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00010000:00010000:1.0:1789126936.408175:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb331 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c537 expref: 16 pid: 9524 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.408196:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104963c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778368:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126936.408223:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.408233:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.408239:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126936.408387:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1789126936.408611:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789126936.408765:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789126936.408860:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1876035276778496:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789126936.408928:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126936.408966:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45240 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.409483:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276778496 00000100:00100000:2.0:1789126936.409491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276778496 00000100:00100000:2.0:1789126936.409560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789126936.409571:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1876035276778496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789126936.409708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6513:x1876035276778496:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126936.409716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789126936.410956:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1876035276778496:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789126936.411185:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789126936.411284:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1876035276778624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789126936.411360:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126936.411421:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204d700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.412445:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276778624 00000100:00100000:2.0:1789126936.412456:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276778624 00000100:00100000:2.0:1789126936.412535:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789126936.412547:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1876035276778624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789126936.412818:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1876035276778624:12345-0@lo:1000:mdt00_001.0 Request processed in 272us (1457us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789126936.412827:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789126936.413098:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1876035276778624:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789126936.413164:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413176:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413185:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413192:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.413198:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413206:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413226:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:1.0:1789126936.413229:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126936.413236:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413242:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb37e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413273:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413280:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413285:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413300:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.413303:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413309:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413317:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126936.413320:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126936.413329:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413342:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413353:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.413390:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.413418:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778752:192.168.203.23@tcp:105: 00000100:00100000:1.0:1789126936.413505:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.426967:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126936.427130:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276778752:192.168.203.23@tcp:105: 00010000:00010000:1.0:1789126936.427168:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427215:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb2c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427262:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427280:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427294:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427307:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427314:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427321:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427328:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.427332:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427340:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427354:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126936.427358:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126936.427362:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427375:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb385 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427389:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427396:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427414:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427420:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126936.427424:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427431:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427440:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126936.427442:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789126936.427445:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126936.427452:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb377 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126936.427718:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11647:x1876035258880256:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 38106us (38522us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789126936.427731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00000020:00080000:1.0:1789126936.427745:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789126936.428183:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126936.428189:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126936.429039:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789126936.429053:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789126936.429308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880640 00000100:00100000:0.0:1789126936.429318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880640 00000100:00100000:0.0:1789126936.429427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1789126936.429439:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11646:x1876035258880640:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:0.0:1789126936.429593:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11646:x1876035258880640:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 156us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.429602:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1789126936.436426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.440435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258880896 00000100:00100000:3.0:1789126936.440458:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258880896 00000100:00100000:3.0:1789126936.440555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:3.0:1789126936.440567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:11646:x1876035258880896:12345-192.168.203.23@tcp:58:lfs.0 00000040:00080000:2.0:1789126936.440959:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789126936.441042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126936.441129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258881152 00000100:00100000:0.0:1789126936.441135:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258881152 00000100:00100000:0.0:1789126936.441173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1789126936.441181:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212264850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:11647:x1876035258881152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789126936.441423:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789126936.441464:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789126936.441505:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.441507:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11646:x1876035258880896:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 941us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126936.441524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 140 00010000:00010000:0.0:1789126936.441525:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.441538:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.441548:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.441555:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.441561:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.441581:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789126936.441594:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126936.441600:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.441608:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126936.441613:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.441622:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.441636:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:2.0:1789126936.441640:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789126936.441669:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.441676:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb38c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.441709:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126936.441711:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126936.441712:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126936.447102:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212264850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:11647:x1876035258881152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 5901us (6040us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789126936.447123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000020:00080000:0.0:1789126936.447134:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789126936.484482:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126936.485699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258881280 00000100:00100000:2.0:1789126936.485715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258881280 00000100:00100000:2.0:1789126936.485819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:2.0:1789126936.485831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:11649:x1876035258881280:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126936.485862:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126936.485891:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb393 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c553 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.485989:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486008:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486022:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486038:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486053:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486161:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486192:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486201:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486244:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.486261:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 22 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126936.486278:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276778880:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126936.486495:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420956f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789126936.492495:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126936.492688:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410481b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276778880:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126936.492727:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.494012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258881536 00000100:00100000:0.0:1789126936.494026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258881536 00000100:00100000:1.0:1789126936.494394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1789126936.494417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:6159:x1876035258881536:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789126936.494768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:6159:x1876035258881536:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 361us (2284us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789126936.494777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1789126936.507307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126936.507441:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258881664 00000100:00100000:0.0:1789126936.507454:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258881664 00010000:00010000:0.0:1789126936.507505:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 24 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126936.507550:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:0.0:1789126936.507561:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:2394:x1876035258881664:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126936.507578:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126936.507585:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 24 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507602:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 24 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507630:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb2b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c514 expref: 24 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507700:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126936.507706:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507718:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507727:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126936.507768:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126936.507829:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:2394:x1876035258881664:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 269us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.507859:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 91 00010000:00010000:2.0:1789126936.507980:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.507989:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126936.508057:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789126936.508063:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126936.508087:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508102:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508128:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508134:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508141:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508148:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126936.508154:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508163:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508174:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:2.0:1789126936.508178:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126936.508182:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508189:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb39a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508201:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508207:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508214:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508225:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126936.508228:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508234:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508244:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff994103ea9900) 00010000:00010000:2.0:1789126936.508246:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126936.508249:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508256:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb3a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508297:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb393 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c553 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508312:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c553 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126936.508320:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126936.508323:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126936.508325:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3a00, rc 0) 00000100:00100000:2.0:1789126936.508366:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11649:x1876035258881280:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 22529us (23891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126936.508373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:2.0:1789126936.747144:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789126936.747185:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276779136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126936.747277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126936.747352:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779136 00000100:00100000:2.0:1789126936.747361:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779136 00000100:00100000:2.0:1789126936.747426:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789126936.747436:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276779136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126936.747463:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1789126936.747506:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276779136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126936.747514:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789126936.747536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126936.747575:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276779136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126936.748084:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276779008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126936.748141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126936.748587:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779008 00000100:00100000:0.0:1789126936.748594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779008 00000100:00100000:0.0:1789126936.748637:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789126936.748645:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276779008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789126936.748686:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1789126936.748731:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276779008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126936.748739:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789126936.748782:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276779008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789126937.002801:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789126937.323990:0:14995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789126937.324002:0:14995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789126937.324042:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789126937.324051:0:14995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789126937.451378:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126937.451392:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789126937.451427:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789126937.451435:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789126937.453758:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276779264:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789126937.453886:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e2bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1789126937.461084:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276779264:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789126937.461354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126937.461432:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258881792 00000100:00100000:0.0:1789126937.461441:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258881792 00000100:00100000:0.0:1789126937.461575:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:0.0:1789126937.461588:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11661:x1876035258881792:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789126937.461634:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789126937.462113:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11661:x1876035258881792:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 525us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126937.462122:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:1.0:1789126937.467406:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126937.467515:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882048 00000100:00100000:3.0:1789126937.467530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882048 00000100:00100000:3.0:1789126937.467609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:3.0:1789126937.467621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:11661:x1876035258882048:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126937.467670:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126937.467699:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c55a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126937.467850:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb3b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126937.467881:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126937.467896:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126937.467911:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789126937.468058:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c55a expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126937.468078:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c55a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126937.468087:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126937.468163:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126937.468168:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216c800, rc 0) 00000100:00100000:3.0:1789126937.468314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:11661:x1876035258882048:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 693us (918us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789126937.468321:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:1.0:1789126937.476582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.476726:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.476775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882432 00000100:00100000:1.0:1789126937.476787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882432 00000100:00100000:1.0:1789126937.476878:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:1.0:1789126937.476891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:11661:x1876035258882432:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789126937.477022:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477045:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477081:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477521:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477532:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477540:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477547:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126937.477557:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477566:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477581:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126937.477584:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789126937.477589:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126937.477596:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb3c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126937.477897:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:11661:x1876035258882432:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 1005us (1166us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789126937.477911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000040:00080000:1.0:1789126937.478185:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126937.478191:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789126937.479173:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882176 00000100:00100000:0.0:1789126937.479187:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882176 00000100:00100000:0.0:1789126937.479265:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:0.0:1789126937.479276:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:2393:x1876035258882176:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126937.479294:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126937.479319:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb3b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c55a expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126937.479340:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:0.0:1789126937.479346:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126937.479405:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:2393:x1876035258882176:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 131us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126937.479413:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000040:00080000:1.0:1789126937.480283:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789126937.480301:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789126937.485922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126937.486039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882688 00000100:00100000:3.0:1789126937.486053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882688 00000100:00100000:3.0:1789126937.486136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1789126937.486148:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:11661:x1876035258882688:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789126937.486452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:11661:x1876035258882688:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 306us (541us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789126937.486461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1789126937.771783:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789126937.771816:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276779392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126937.771925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126937.772779:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779392 00000100:00100000:0.0:1789126937.772792:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779392 00000100:00100000:0.0:1789126937.773316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789126937.773330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276779392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789126937.773381:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789126937.773482:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276779392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126937.773491:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789126937.773588:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276779392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126937.950586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.950680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.950716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.950752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126937.950995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882816 00000100:00100000:0.0:1789126937.951009:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882816 00000100:00100000:0.0:1789126937.951088:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 440 00000100:00100000:0.0:1789126937.951110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258882816:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126937.951205:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883072 00000100:00100000:3.0:1789126937.951210:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883072 00000100:00100000:3.0:1789126937.951263:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:0.0:1789126937.951270:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258882816:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 169us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126937.951274:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258883072:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126937.951306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 440 00000100:00100000:3.0:1789126937.951311:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258883072:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 40us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126937.951320:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00080000:3.0:1789126937.951343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126937.951366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258882944 00000100:00100000:3.0:1789126937.951374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258882944 00000100:00100000:3.0:1789126937.951405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883328 00000100:00100000:3.0:1789126937.951408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883328 00000100:00100000:3.0:1789126937.951426:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:3.0:1789126937.951432:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258882944:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126937.951463:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258882944:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126937.951470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:3.0:1789126937.951484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:3.0:1789126937.951490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258883328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126937.951516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258883328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126937.951523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 291 00000100:00100000:1.0:1789126937.951930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.952026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126937.952127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883456 00000100:00100000:1.0:1789126937.952133:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883456 00000100:00100000:1.0:1789126937.952168:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00100000:1.0:1789126937.952175:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258883456:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:0.0:1789126937.952437:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789126937.952443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126937.954090:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883200 00000100:00100000:3.0:1789126937.954114:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883200 00000100:00100000:1.0:1789126937.954736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2393:x1876035258883456:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2550us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126937.954750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00100000:3.0:1789126937.955399:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1789126937.955416:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258883200:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126937.955530:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258883200:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 113us (3593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126937.955538:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00010000:00010000:1.0:1789126938.031017:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126939.050816:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789126939.162441:0:15047:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789126939.162455:0:15047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789126939.162509:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789126939.162519:0:15047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126939.299081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126939.299128:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883712 00000100:00100000:3.0:1789126939.299137:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883712 00000100:00100000:3.0:1789126939.299200:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:3.0:1789126939.299211:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:11682:x1876035258883712:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126939.299234:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126939.299255:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb3cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c561 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126939.300625:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126939.300640:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126939.302701:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126939.302893:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789126939.303039:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb3cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c561 expref: 28 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126939.303567:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c561 expref: 27 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126939.303591:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:3.0:1789126939.303595:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789126939.303599:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d600, rc 0) 00000100:00100000:3.0:1789126939.303692:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410481b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:11682:x1876035258883712:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4482us (5433us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789126939.304009:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00080000:3.0:1789126939.304044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126939.306846:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126939.306869:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276779520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126939.306948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.307290:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779520 00000100:00100000:2.0:1789126939.307299:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779520 00000100:00100000:2.0:1789126939.307368:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789126939.307380:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276779520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126939.307417:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789126939.307470:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276779520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.307478:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789126939.307528:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276779520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126939.307598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126939.307623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883840 00000100:00100000:2.0:1789126939.307627:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883840 00000100:00100000:2.0:1789126939.307691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:2.0:1789126939.307717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:11682:x1876035258883840:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1789126939.307771:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307788:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307801:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307832:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307840:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307848:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307855:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126939.307859:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307867:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307879:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:2.0:1789126939.307882:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126939.307887:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126939.307894:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb3e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126939.307963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:11682:x1876035258883840:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 238us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.307972:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00080000:0.0:1789126939.308473:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126939.308823:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.308872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.308905:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276780544:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.308919:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276779776:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.308944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.308980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.308988:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276781056:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276780288:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.309058:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789126939.309064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.309070:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276779648:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309089:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276780800:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.309131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.309150:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276780160:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309173:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789126939.309180:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276779904:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309186:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.309215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.309218:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276780672:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309233:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276780416:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.309261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126939.309270:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.309296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780032 00000100:00100000:0.0:1789126939.309303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780032 00000100:00100000:2.0:1789126939.309308:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780160 00000100:00100000:2.0:1789126939.309312:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780160 00000100:00100000:0.0:1789126939.309341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779776 00000100:00100000:2.0:1789126939.309342:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779904 00000100:00100000:2.0:1789126939.309345:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779904 00000100:00100000:2.0:1789126939.309355:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789126939.309356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779776 00000100:00100000:2.0:1789126939.309362:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276780160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780288 00000100:00100000:0.0:1789126939.309390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780288 00000100:00100000:2.0:1789126939.309398:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276780160:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.309418:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780800 00000100:00100000:2.0:1789126939.309423:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789126939.309423:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780800 00000100:00100000:2.0:1789126939.309438:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789126939.309446:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276779904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.309447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780416 00000100:00100000:0.0:1789126939.309456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780416 00000100:00100000:2.0:1789126939.309475:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276779904:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.309477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780928 00000100:00100000:2.0:1789126939.309481:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789126939.309483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780928 00000100:00100000:2.0:1789126939.309499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789126939.309505:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276780032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.309522:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276780032:12345-0@lo:400:kworker.0 Request processed in 19us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.310436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789126939.310445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789126939.310458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276779776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789126939.310473:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276780288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310519:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276780288:12345-0@lo:400:kworker.0 Request processed in 49us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.310523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789126939.310531:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789126939.310535:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276780800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276780800:12345-0@lo:400:kworker.0 Request processed in 16us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.310554:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789126939.310560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789126939.310565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276780416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.310570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276779776:12345-0@lo:400:kworker.0 Request processed in 114us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.310579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789126939.310593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104aff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276780416:12345-0@lo:400:kworker.0 Request processed in 28us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.310600:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789126939.310609:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789126939.310614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276780928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.310682:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276780928:12345-0@lo:400:kworker.0 Request processed in 72us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126939.310684:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276779904:0@lo:400:kworker.0 00010000:00080000:2.0:1789126939.310701:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104afcb40 x1876035276780416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126939.310708:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276780416:0@lo:400:kworker.0 00010000:00080000:2.0:1789126939.310714:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104afc780 x1876035276780928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126939.310719:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310726:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276779776:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310731:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276780288:0@lo:400:kworker.0 00000100:00100000:2.0:1789126939.310737:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276780800:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.310755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789126939.310783:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780544 00000100:00100000:0.0:1789126939.310788:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780544 00000100:00100000:0.0:1789126939.310828:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781056 00000100:00100000:0.0:1789126939.310831:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781056 00000100:00100000:0.0:1789126939.310845:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276780672 00000100:00100000:0.0:1789126939.310847:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276780672 00000100:00100000:0.0:1789126939.310860:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126939.310866:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276780544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.310900:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276780544:12345-0@lo:400:kworker.0 Request processed in 33us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.310906:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789126939.310918:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789126939.310932:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e2ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276781056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.310977:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e2ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276781056:12345-0@lo:400:kworker.0 Request processed in 46us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.310983:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789126939.311099:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789126939.311106:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311134:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276780672:12345-0@lo:400:kworker.0 Request processed in 29us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.311141:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789126939.311164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276779648 00000100:00100000:0.0:1789126939.311168:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276779648 00000100:00100000:0.0:1789126939.311194:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789126939.311201:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276779648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276779648:12345-0@lo:400:kworker.0 Request processed in 31us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.311238:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00080000:0.0:1789126939.311272:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126939.311276:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126939.311279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126939.311281:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126939.311306:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276779648:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311319:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276780160:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276780672:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311340:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104affc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276781056:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311351:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.311370:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276780544:0@lo:400:kworker.0 00000100:00100000:0.0:1789126939.314418:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276781184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126939.314487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126939.314835:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781184 00000100:00100000:0.0:1789126939.314843:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781184 00000100:00100000:0.0:1789126939.314878:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789126939.314885:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276781184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789126939.314904:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789126939.314970:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876035276781184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.314979:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789126939.315021:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276781184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126939.411204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126939.411311:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258883968 00000100:00100000:0.0:1789126939.411321:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258883968 00000100:00100000:0.0:1789126939.411403:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1789126939.411414:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104aff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258883968:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:0.0:1789126939.411431:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126939.411452:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055115d8b/0xa840b4da666eb3e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c568 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789126939.411476:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3e917, atime: 0x6aa3e917, ctime: 0x6aa3e917, blocks: 0x8 00010000:00010000:0.0:1789126939.411495:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1789126939.411500:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126939.411509:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055115d8b/0xa840b4da666eb3e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c568 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126939.411546:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055115d8b/0xa840b4da666eb3e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c568 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126939.411556:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167a00, rc 0) 00000100:00080000:2.0:1789126939.411677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126939.412211:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104aff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258883968:12345-192.168.203.23@tcp:101:cat.0 Request processed in 797us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126939.412219:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:2.0:1789126939.416321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126939.416567:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884096 00000100:00100000:1.0:1789126939.416588:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884096 00002000:00100000:1.0:1789126939.416638:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff994104afe1c0 x1876035258884096/t0(0) o3->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:430/0 lens 488/0 e 0 to 0 dl 1789126950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126939.416705:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104afe1c0 with x1876035258884096 ext(0->4095) 00002000:00010000:1.0:1789126939.416712:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994104afe1c0 00000100:00100000:1.0:1789126939.416754:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1789126939.416765:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258884096:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:1.0:1789126939.417262:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258884096:12345-192.168.203.23@tcp:3:cat.0 Request processed in 498us (948us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789126939.417272:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:1.0:1789126939.417279:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff994104afe1c0 x1876035258884096/t0(0) o3->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:430/0 lens 488/4536 e 0 to 0 dl 1789126950 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126939.417288:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104afe1c0 with x1876035258884096 ext(0->4095) 00002000:00010000:1.0:1789126939.417292:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994104afe1c0 00010000:00010000:3.0:1789126940.083770:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126941.105351:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126941.355271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276781312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126941.355406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126941.355679:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781312 00000100:00100000:0.0:1789126941.355689:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781312 00000100:00100000:0.0:1789126941.355748:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789126941.355759:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276781312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126941.355796:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126941.355877:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276781312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126941.355892:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789126941.356669:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276781312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126941.867352:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276781440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126941.867443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126941.867641:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781440 00000100:00100000:3.0:1789126941.867674:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781440 00000100:00100000:3.0:1789126941.867771:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1789126941.867964:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126941.868154:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276781440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789126941.868201:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126941.868305:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276781440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 523us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126941.868316:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789126941.868401:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276781440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126941.869361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276781568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789126941.869481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126941.869681:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781568 00000100:00100000:1.0:1789126941.869688:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781568 00000100:00100000:1.0:1789126941.869743:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789126941.869753:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276781568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789126941.869777:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789126941.870764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126941.870925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276781568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1170us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126941.870944:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000001:00080000:0.0:1789126941.871172:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1789126941.871180:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1789126941.871326:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276781568:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789126941.871729:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789126941.871759:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9942202b3e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789126941.871763:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994220016d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9942202b3d80 00000020:00080000:1.0:1789126941.871777:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994220016100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994104996200 00000020:00080000:1.0:1789126941.871799:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789126941.871811:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789126941.871875:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789126941.871945:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.871957:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.871975:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.871982:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126941.871986:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.871995:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.872011:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff994236490a00) 00010000:00010000:2.0:1789126941.872015:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126941.872020:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126941.872026:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb362 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126941.872193:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:1.0:1789126942.125252:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126942.896130:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276781696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126942.896228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126942.896333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781696 00000100:00100000:1.0:1789126942.896344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781696 00000100:00100000:1.0:1789126942.896479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789126942.896500:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276781696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789126942.896548:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789126942.896614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276781696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126942.896622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789126942.896793:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276781696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126943.058099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.058203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884352 00000100:00100000:2.0:1789126943.058207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.058217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884352 00000100:00100000:2.0:1789126943.058240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126943.058271:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.058302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884864 00000100:00100000:2.0:1789126943.058303:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126943.058323:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.058334:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884864 00000100:00100000:2.0:1789126943.058351:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.058355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884480 00000100:00100000:0.0:1789126943.058357:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884480 00000100:00100000:0.0:1789126943.058372:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884992 00000100:00100000:0.0:1789126943.058375:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884992 00000100:00100000:2.0:1789126943.058381:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884608 00000100:00100000:2.0:1789126943.058385:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884608 00000100:00100000:0.0:1789126943.058393:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 299 00000100:00100000:0.0:1789126943.058409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2391:x1876035258884352:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126943.058417:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884736 00000100:00100000:2.0:1789126943.058427:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884736 00000100:00100000:1.0:1789126943.058624:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258884224 00000100:00100000:1.0:1789126943.058630:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258884224 00000100:00100000:1.0:1789126943.058687:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 442 00000100:00100000:1.0:1789126943.058696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258884224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126943.058783:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258884224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 77us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.058793:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2391:x1876035258884352:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 387us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126943.058797:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 442 00000100:00100000:0.0:1789126943.058809:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 299 00000100:00100000:0.0:1789126943.058829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 300 00000100:00100000:0.0:1789126943.058838:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258884864:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126943.058874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258884864:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.058880:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 300 00000100:00100000:0.0:1789126943.058893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 301 00000100:00100000:0.0:1789126943.058901:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258884480:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126943.058942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258884480:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.058950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 301 00000100:00100000:0.0:1789126943.058963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 302 00000100:00100000:0.0:1789126943.058969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258884992:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126943.059009:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258884992:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 40us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.059017:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 302 00000100:00080000:0.0:1789126943.060310:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126943.060318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126943.060323:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126943.060327:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126943.060364:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:1.0:1789126943.060376:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1789126943.060382:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258884608:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126943.060393:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104affc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258884736:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126943.060457:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104affc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2391:x1876035258884736:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126943.060466:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1789126943.060511:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258884608:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 136us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126943.060518:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00010000:00010000:2.0:1789126943.147107:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126943.594550:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.594709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258885120 00000100:00100000:0.0:1789126943.594721:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258885120 00000100:00100000:0.0:1789126943.594796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:0.0:1789126943.594808:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:11327:x1876035258885120:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789126943.595090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:11327:x1876035258885120:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 163us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.595102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:2.0:1789126943.605839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.606064:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258885248 00000100:00100000:0.0:1789126943.606077:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258885248 00000100:00100000:0.0:1789126943.606189:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:0.0:1789126943.606201:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:11327:x1876035258885248:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789126943.606405:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:11327:x1876035258885248:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 205us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.606414:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:3.0:1789126943.610483:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126943.610765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258885504 00000100:00100000:1.0:1789126943.610788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258885504 00000100:00100000:1.0:1789126943.610901:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:1.0:1789126943.610914:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:11327:x1876035258885504:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789126943.611482:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:11327:x1876035258885504:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 567us (1011us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789126943.611492:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:2.0:1789126943.860216:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126943.860408:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258885632 00000100:00100000:0.0:1789126943.860421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258885632 00000100:00100000:0.0:1789126943.860507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:0.0:1789126943.860527:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:12140:x1876035258885632:12345-192.168.203.23@tcp:101:lsof.0 00010000:00010000:0.0:1789126943.860554:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126943.860581:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb3ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c56f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860702:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860739:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860756:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126943.860828:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789126943.860833:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126943.860884:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860914:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb3ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860950:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126943.860960:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:0.0:1789126943.860963:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126943.860967:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167400, rc 0) 00000100:00100000:0.0:1789126943.861111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:12140:x1876035258885632:12345-192.168.203.23@tcp:101:lsof.0 Request processed in 534us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126943.861121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 149 00010000:00010000:3.0:1789126944.171138:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126944.427592:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276781824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126944.427718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126944.427910:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276781952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126944.427996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126944.428170:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781824 00000100:00100000:0.0:1789126944.428182:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781824 00000100:00100000:0.0:1789126944.428263:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276781952 00000100:00100000:0.0:1789126944.428267:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276781952 00000100:00100000:0.0:1789126944.428292:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789126944.428303:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276781824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789126944.428359:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789126944.428422:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276781824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126944.428432:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789126944.428453:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789126944.428474:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276781952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126944.428485:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789126944.428523:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276781952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126944.428530:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789126944.428548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126944.431337:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276782080:0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.431438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.431499:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789126944.431513:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99422fb8c780, transno 4294967311 00000004:00080000:3.0:1789126944.431534:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789126944.431570:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276781824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126944.431597:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276782336:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.431675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126944.435282:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782080 00000100:00100000:1.0:1789126944.435295:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782080 00000100:00100000:1.0:1789126944.435352:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789126944.435362:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276782080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.435447:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994229769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276782080:12345-0@lo:400:kworker.0 Request processed in 86us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126944.435455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789126944.435604:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276782208:0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.435725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.436708:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994236680780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276782848:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.436754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.436785:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276783360:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.436807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.436838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789126944.436846:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276782464:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.436873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.436897:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276782976:0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.437336:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276782720:0@lo:400:kworker.0 00000100:00100000:2.0:1789126944.437368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782208 00000100:00100000:2.0:1789126944.437375:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782208 00000100:00100000:2.0:1789126944.437411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782848 00000100:00100000:2.0:1789126944.437414:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782848 00000100:00100000:2.0:1789126944.437441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783360 00000100:00100000:2.0:1789126944.437444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783360 00000100:00100000:2.0:1789126944.437464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782464 00000100:00100000:2.0:1789126944.437468:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782464 00000100:00100000:1.0:1789126944.437471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126944.437472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126944.437489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782720 00000100:00100000:1.0:1789126944.437492:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276783232:0@lo:400:kworker.0 00000100:00100000:2.0:1789126944.437494:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782720 00000100:00100000:3.0:1789126944.437511:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782976 00000100:00100000:3.0:1789126944.437517:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782976 00000100:00100000:2.0:1789126944.437522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789126944.437528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126944.437535:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.437563:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789126944.437574:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.437588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782336 00000100:00100000:1.0:1789126944.437594:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782336 00000100:00100000:2.0:1789126944.437602:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276782208:12345-0@lo:400:kworker.0 Request processed in 69us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.437611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789126944.437627:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276782976:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.437630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783232 00000100:00100000:1.0:1789126944.437633:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789126944.437638:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789126944.437663:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783232 00000100:00100000:2.0:1789126944.437689:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789126944.437696:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276782848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.437730:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276782336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126944.437733:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276782848:12345-0@lo:400:kworker.0 Request processed in 36us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.437742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789126944.437757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789126944.437764:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276783360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.437777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276782336:12345-0@lo:400:kworker.0 Request processed in 52us (6101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.437802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276783360:12345-0@lo:400:kworker.0 Request processed in 39us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.437809:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789126944.437824:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789126944.437830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276782464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.437881:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276782080:0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.437898:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276782592:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438285:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276782976:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438309:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276782336:0@lo:400:kworker.0 00010000:00080000:3.0:1789126944.438321:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994236680780 x1876035276782848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126944.438331:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994236680780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276782848:0@lo:400:kworker.0 00010000:00080000:3.0:1789126944.438341:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410406b0c0 x1876035276783360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126944.438349:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276783360:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789126944.438414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276782720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276782720:12345-0@lo:400:kworker.0 Request processed in 40us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126944.438458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789126944.438472:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789126944.438478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276783232:12345-0@lo:400:kworker.0 Request processed in 27us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126944.438510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789126944.438546:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276781952:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789126944.438571:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126944.438576:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126944.438579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126944.438600:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276782208:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438609:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276782720:0@lo:400:kworker.0 00000100:00100000:3.0:1789126944.438627:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276783232:0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.439192:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126944.439241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276783104:0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.439274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126944.439408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789126944.439428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276782592 00000100:00100000:1.0:1789126944.439433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276782592 00000100:00100000:1.0:1789126944.439469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789126944.439476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276782592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.439528:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276782592:12345-0@lo:400:kworker.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126944.439535:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789126944.439566:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783104 00000100:00100000:1.0:1789126944.439570:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783104 00000100:00100000:1.0:1789126944.439599:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789126944.439606:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276783104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126944.440185:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276782592:0@lo:400:kworker.0 00000100:00100000:1.0:1789126944.440199:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276783104:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126944.440203:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789126944.440214:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9941049621c0, transno 4294967305 00000100:00100000:1.0:1789126944.440222:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789126944.440236:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422f99d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276783104:0@lo:400:kworker.0 00000100:00080000:1.0:1789126944.440256:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126944.441467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276782464:12345-0@lo:400:kworker.0 Request processed in 3632us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126944.441478:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789126944.441627:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276782464:0@lo:400:kworker.0 00000040:00080000:2.0:1789126945.003435:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789126945.196998:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789126945.709701:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126945.709711:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126945.709783:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789126945.709791:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789126946.219666:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789126946.254373:0:15244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:42:24 (1789126944) 00000100:00100000:3.0:1789126946.474935:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276783488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126946.475076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126946.475219:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783488 00000100:00100000:1.0:1789126946.475235:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783488 00000100:00100000:1.0:1789126946.475349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789126946.475361:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276783488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789126946.475414:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789126946.475512:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276783488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126946.475521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789126946.475711:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276783488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126946.986966:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126946.989432:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126946.989459:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276783744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126946.989534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126946.989612:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783744 00000100:00100000:0.0:1789126946.989620:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783744 00000100:00100000:2.0:1789126946.990272:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276783616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126946.990315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126946.990352:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783616 00000100:00100000:2.0:1789126946.990356:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783616 00000100:00100000:2.0:1789126946.990400:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789126946.990409:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276783616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126946.990440:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126946.990495:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276783616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126946.990502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789126946.990607:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276783616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789126946.990661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126946.990763:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789126946.990771:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276783744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789126946.990781:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789126946.990814:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276783744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126946.990820:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789126946.990849:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276783744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126947.029514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126947.030368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258885888 00000100:00100000:3.0:1789126947.030378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258885888 00000100:00100000:3.0:1789126947.030508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:3.0:1789126947.030521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12406:x1876035258885888:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126947.030554:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126947.030575:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb3fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c576 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030645:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030686:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030700:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030736:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030743:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030845:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb411 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030854:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb411 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.030861:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb411 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126947.030870:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789126947.031777:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031790:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031797:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031802:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126947.031807:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031814:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031910:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103eaaf00) 00010000:00010000:3.0:1789126947.031914:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126947.031918:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031925:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb403 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031941:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031947:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031954:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.031959:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc193f4f0) 00000001:00080000:1.0:1789126947.034688:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1789126947.034710:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789126947.034727:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789126947.034744:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789126947.034948:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.035324:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.035343:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994236492100) 00010000:00010000:3.0:1789126947.035346:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126947.035351:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.035358:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb40a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789126947.036396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789126947.038237:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb3fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c576 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.038263:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb411 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c576 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126947.038272:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:3.0:1789126947.038275:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126947.038278:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216dc00, rc 0) 00000100:00100000:3.0:1789126947.038448:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12406:x1876035258885888:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 7929us (8942us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789126947.038455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:3.0:1789126947.043697:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126947.043735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126947.043814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886016 00000100:00100000:0.0:1789126947.043823:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886016 00000100:00100000:0.0:1789126947.043893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:0.0:1789126947.043913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12406:x1876035258886016:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789126947.044022:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12406:x1876035258886016:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126947.044030:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:1.0:1789126947.045550:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886144 00000100:00100000:1.0:1789126947.045561:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886144 00000100:00100000:1.0:1789126947.045616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1789126947.045626:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:2391:x1876035258886144:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126947.045639:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126947.045683:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb411 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c576 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126947.045704:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:1.0:1789126947.045709:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126947.045754:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2391:x1876035258886144:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 130us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126947.045761:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1789126947.046265:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126947.046393:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886272 00000100:00100000:3.0:1789126947.046398:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886272 00000100:00100000:3.0:1789126947.046493:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:3.0:1789126947.046502:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:12406:x1876035258886272:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789126947.046569:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:12406:x1876035258886272:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126947.046576:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00080000:1.0:1789126947.047445:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789126947.052796:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789126947.242981:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789126947.754824:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126947.754836:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126947.754859:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789126947.754871:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126948.010866:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276783872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126948.010955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126948.011025:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276783872 00000100:00100000:3.0:1789126948.011032:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276783872 00000100:00100000:3.0:1789126948.011073:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789126948.011082:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276783872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126948.011113:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789126948.011156:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994236680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276783872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.011163:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789126948.011202:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276783872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126948.177934:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.177986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.178014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.178039:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126948.178043:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886400 00000100:00100000:0.0:1789126948.178054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886400 00000100:00100000:3.0:1789126948.178063:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.178092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126948.178113:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 444 00000100:00100000:0.0:1789126948.178127:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258886400:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178129:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.178153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886528 00000100:00100000:3.0:1789126948.178158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886528 00000100:00100000:3.0:1789126948.178182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886656 00000100:00100000:3.0:1789126948.178185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886656 00000100:00100000:3.0:1789126948.178197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887040 00000100:00100000:0.0:1789126948.178199:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422976bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2394:x1876035258886400:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178201:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887040 00000100:00100000:0.0:1789126948.178211:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 444 00000100:00100000:3.0:1789126948.178233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887168 00000100:00100000:3.0:1789126948.178237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887168 00000100:00100000:3.0:1789126948.178386:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 309 00000100:00100000:3.0:1789126948.178394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2393:x1876035258886528:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2393:x1876035258886528:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 309 00000100:00100000:3.0:1789126948.178454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 310 00000100:00100000:3.0:1789126948.178462:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258886656:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258886656:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178495:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 310 00000100:00100000:3.0:1789126948.178508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 311 00000100:00100000:3.0:1789126948.178514:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2393:x1876035258887040:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104132d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2393:x1876035258887040:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 311 00000100:00100000:3.0:1789126948.178557:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 312 00000100:00100000:3.0:1789126948.178563:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258887168:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258887168:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 312 00000100:00100000:3.0:1789126948.178613:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886784 00000100:00100000:3.0:1789126948.178616:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886784 00000100:00100000:3.0:1789126948.178680:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258886912 00000100:00100000:3.0:1789126948.178683:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258886912 00000100:00100000:3.0:1789126948.178707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:3.0:1789126948.178713:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258886784:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178741:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2393:x1876035258886784:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178754:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:3.0:1789126948.178766:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1789126948.178771:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258886912:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126948.178795:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258886912:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.178800:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00080000:3.0:1789126948.180202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126948.180208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126948.180211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126948.180214:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789126948.267190:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126948.368473:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.368554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887296 00000100:00100000:3.0:1789126948.368564:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887296 00000100:00100000:3.0:1789126948.368800:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:3.0:1789126948.368811:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:12449:x1876035258887296:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126948.368832:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.368853:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb41f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c57d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368928:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368942:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368952:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368965:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368985:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.368992:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369035:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369041:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369046:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369052:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.369055:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369061:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369072:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:3.0:1789126948.369075:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.369079:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369085:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369094:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369106:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369112:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369117:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216ca00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.369119:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369125:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369132:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994236492100) 00010000:00010000:3.0:1789126948.369135:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.369137:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369143:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb42d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369174:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb41f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c57d expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369184:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:3.0:1789126948.369186:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.369189:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb41f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c57d expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.369197:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216d000, rc 0) 00000100:00100000:3.0:1789126948.369259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:12449:x1876035258887296:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 450us (796us total) trans 0 rc 301/301 00000100:00100000:3.0:1789126948.369266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:0.0:1789126948.378779:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.379954:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887552 00000100:00100000:2.0:1789126948.379965:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887552 00000100:00100000:2.0:1789126948.380024:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:2.0:1789126948.380034:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:12449:x1876035258887552:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:2.0:1789126948.380086:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126948.380112:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666ead73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.380128:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:2.0:1789126948.380133:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126948.380196:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.380211:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.380220:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.380251:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.380278:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 5 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126948.380291:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276784000:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126948.380377:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789126948.383630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.383861:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276784000:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126948.383888:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126948.383975:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887680 00000100:00100000:1.0:1789126948.383981:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887680 00010000:00010000:1.0:1789126948.384027:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 6 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126948.384067:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:1.0:1789126948.384077:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2394:x1876035258887680:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126948.384092:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126948.384099:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 6 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384119:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 6 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384142:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb3f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c56f expref: 6 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384155:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:1.0:1789126948.384160:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384169:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384176:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.384208:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126948.384259:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2394:x1876035258887680:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 183us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126948.384267:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00010000:00010000:2.0:1789126948.384392:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.384400:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.384422:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.384432:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.384441:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385039:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385050:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385066:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126948.385084:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ff175fa5 reply state 00000000de60ec08 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385096:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385103:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126948.385106:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126948.385109:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789126948.385114:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789126948.385122:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385129:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385136:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385142:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126948.385147:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385155:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385166:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994102e04300) 00010000:00010000:2.0:1789126948.385169:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126948.385181:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385189:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb434 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126948.385213:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ff175fa5 reply state 00000000de60ec08 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385222:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.385229:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994103ea9100) 00010000:00010000:2.0:1789126948.385231:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126948.385233:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789126948.385302:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12449:x1876035258887552:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 5261us (6525us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789126948.385311:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:2.0:1789126948.480015:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.480101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887808 00000100:00100000:3.0:1789126948.480110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887808 00000100:00100000:3.0:1789126948.480172:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 155 00000100:00100000:3.0:1789126948.480183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:12457:x1876035258887808:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:3.0:1789126948.480205:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.480226:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c584 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480293:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480307:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480318:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126948.480362:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789126948.480366:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126948.480387:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480411:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c584 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480428:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c584 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.480453:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:3.0:1789126948.480456:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126948.480459:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216ca00, rc 0) 00000100:00100000:3.0:1789126948.480526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:12457:x1876035258887808:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 344us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.480533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 155 00000100:00100000:0.0:1789126948.544768:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.544860:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258887936 00000100:00100000:3.0:1789126948.544870:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258887936 00000100:00100000:3.0:1789126948.544944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:3.0:1789126948.544964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+15:12463:x1876035258887936:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126948.544984:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.545005:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c58b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545078:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545093:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545104:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545117:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545124:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545147:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545237:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545246:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545253:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126948.545286:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789126948.545291:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126948.545310:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545321:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545327:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545334:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545339:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216d400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.545343:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545349:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545367:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:3.0:1789126948.545370:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.545375:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545382:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d400/0xa840b4da666eb45e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545395:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545400:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545406:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545411:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216dc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.545414:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545420:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545427:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994103ea9100) 00010000:00010000:3.0:1789126948.545430:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.545432:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545438:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216dc00/0xa840b4da666eb465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545473:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d000/0xa840b4da666eb457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c58b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545486:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c58b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.545493:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126948.545495:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789126948.545498:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99424216c800, rc 0) 00000100:00100000:3.0:1789126948.545564:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:12463:x1876035258887936:12345-192.168.203.23@tcp:101:bash.0 Request processed in 601us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.545572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:1.0:1789126948.549465:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.550056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258888192 00000100:00100000:3.0:1789126948.550067:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258888192 00000100:00100000:3.0:1789126948.550182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00100000:3.0:1789126948.550194:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+16:12463:x1876035258888192:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126948.550236:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.550274:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666eb473 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c592 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550378:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550392:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550403:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550452:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550460:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550467:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789126948.550815:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789126948.550968:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550978:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.550985:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551013:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551020:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551026:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551032:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.551036:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551054:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551064:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126948.551067:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.551071:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551076:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb47a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126948.551090:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000aadf9c21 reply state 00000000ae890ad4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551100:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551106:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:3.0:1789126948.551108:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126948.551111:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789126948.551138:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666eb473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551152:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.551159:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:3.0:1789126948.551160:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126948.551163:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66c00, rc 0) 00000100:00100000:3.0:1789126948.551231:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12463:x1876035258888192:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1040us (1775us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789126948.551244:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00100000:0.0:1789126948.555117:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.555444:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258888320 00000100:00100000:3.0:1789126948.555454:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258888320 00000100:00100000:3.0:1789126948.555514:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1789126948.555525:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2394:x1876035258888320:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126948.555542:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.555562:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c599 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126948.555587:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789126948.555604:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1789126948.555609:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126948.555617:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.555634:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.555692:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67200, rc 0) 00000100:00100000:3.0:1789126948.555761:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2394:x1876035258888320:12345-192.168.203.23@tcp:101:bash.0 Request processed in 237us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.555768:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:0.0:1789126948.563965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.564226:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258888448 00000100:00100000:3.0:1789126948.564235:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258888448 00000100:00100000:3.0:1789126948.564290:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1789126948.564300:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:12463:x1876035258888448:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126948.564330:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.564347:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5a0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.564377:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.564386:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126948.564390:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126948.564396:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.564427:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.564440:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126948.564454:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276784128:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126948.564643:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106840 going to sleep for 11 seconds 00000100:00100000:3.0:1789126948.567490:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276784128:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126948.567522:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.567812:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67600, rc 0) 00000100:00100000:2.0:1789126948.568609:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:12463:x1876035258888448:12345-192.168.203.23@tcp:101:bash.0 Request processed in 4305us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126948.568620:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789126948.576042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.576141:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258888576 00000100:00100000:2.0:1789126948.576152:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258888576 00010000:00010000:2.0:1789126948.576206:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126948.576252:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:2.0:1789126948.576263:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258888576:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126948.576294:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126948.576317:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.576331:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.576356:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000030735eb/0xa840b4da666eb496 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c599 expref: 7 pid: 8430 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.576373:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126948.576378:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126948.576387:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.576398:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.576435:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126948.576449:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876035276784256:192.168.203.23@tcp:105: 00000100:00100000:2.0:1789126948.576532:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789126948.590048:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.590356:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876035276784256:192.168.203.23@tcp:105: 00010000:00010000:2.0:1789126948.590380:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126948.590448:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258888576:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 14185us (14412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126948.590459:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:3.0:1789126948.596151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258888832 00000100:00100000:3.0:1789126948.596167:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258888832 00000100:00100000:3.0:1789126948.596248:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:3.0:1789126948.596259:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12463:x1876035258888832:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1789126948.597875:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:12463:x1876035258888832:12345-192.168.203.23@tcp:35:bash.0 Request processed in 1609us (7826us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789126948.597897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1789126948.678190:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.678297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258889088 00000100:00100000:3.0:1789126948.678306:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258889088 00000100:00100000:3.0:1789126948.678373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:3.0:1789126948.678384:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:12473:x1876035258889088:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126948.678408:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126948.678429:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb4a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5a7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126948.678525:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789126948.678617:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb4a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.678631:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:3.0:1789126948.678635:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126948.678640:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb4a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.678742:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66400, rc 0) 00000100:00100000:0.0:1789126948.681311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12473:x1876035258889088:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2918us (3119us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789126948.681324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:2.0:1789126948.685940:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126948.686448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258889344 00000100:00100000:1.0:1789126948.686459:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258889344 00000100:00100000:1.0:1789126948.686516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1789126948.686526:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12473:x1876035258889344:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126948.686776:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:12473:x1876035258889344:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 250us (843us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789126948.686801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1789126948.776099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126948.776235:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258889472 00000100:00100000:0.0:1789126948.776244:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258889472 00000100:00100000:0.0:1789126948.776297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:0.0:1789126948.776306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:12479:x1876035258889472:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126948.776328:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126948.776358:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb4b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5ae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776418:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776432:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776444:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126948.776500:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789126948.776504:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126948.776520:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb4b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ae expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776562:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ae expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.776571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126948.776574:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126948.776578:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166600, rc 0) 00000100:00100000:0.0:1789126948.776631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422f99d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:12479:x1876035258889472:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 326us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126948.776638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:0.0:1789126948.783194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.783302:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258889728 00000100:00100000:2.0:1789126948.783311:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258889728 00000100:00100000:2.0:1789126948.783376:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:2.0:1789126948.783385:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:12479:x1876035258889728:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126948.783405:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126948.783424:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb4c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5b5 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.783518:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.783532:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.783543:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126948.783554:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789126948.783700:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb4c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5b5 expref: 26 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.783739:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5b5 expref: 25 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.783747:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:2.0:1789126948.783750:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126948.783753:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:2.0:1789126948.783817:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12479:x1876035258889728:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 432us (632us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789126948.783826:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:2.0:1789126948.790326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.790380:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.790415:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258889856 00000100:00100000:3.0:1789126948.790424:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258889856 00000100:00100000:0.0:1789126948.790462:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890112 00000100:00100000:0.0:1789126948.790468:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890112 00000100:00100000:0.0:1789126948.790516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:0.0:1789126948.790527:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:12479:x1876035258890112:12345-192.168.203.23@tcp:101:lfs.0 00000100:00100000:3.0:1789126948.790538:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00010000:00010000:0.0:1789126948.790549:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789126948.790555:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:2394:x1876035258889856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126948.790570:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126948.790586:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb4d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5bc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.790607:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5b5 expref: 27 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.790624:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:3.0:1789126948.790629:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126948.790712:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:2394:x1876035258889856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 163us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.790721:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00010000:00010000:0.0:1789126948.790721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.790744:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.790755:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126948.791036:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789126948.791135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb4d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5bc expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.791150:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5bc expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.791157:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:0.0:1789126948.791161:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789126948.791164:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167400, rc 0) 00000100:00100000:0.0:1789126948.791204:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:12479:x1876035258890112:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 679us (823us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789126948.791211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:2.0:1789126948.797325:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.797415:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890240 00000100:00100000:3.0:1789126948.797424:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890240 00000100:00100000:3.0:1789126948.797480:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1789126948.797490:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2392:x1876035258890240:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:3.0:1789126948.797529:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.797549:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.797559:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789126948.797563:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126948.797568:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.797603:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.797617:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 6 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126948.797645:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276784384:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126948.797788:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106840 going to sleep for 11 seconds 00000100:00100000:1.0:1789126948.801824:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.802233:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276784384:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126948.802261:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126948.802363:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890368 00000100:00100000:2.0:1789126948.802370:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890368 00002000:00100000:2.0:1789126948.802417:0:8434:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff994104b40f00 x1876035258890368/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:439/0 lens 504/0 e 0 to 0 dl 1789126959 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126948.802427:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104b40f00 with x1876035258890368 ext(0->12) 00010000:00010000:2.0:1789126948.802436:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 7 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.802451:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 7 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126948.802460:0:8434:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff994104b40f00 00000100:00100000:2.0:1789126948.802495:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1789126948.802519:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258890368:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:2.0:1789126948.804843:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258890368:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 2316us (3018us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789126948.804857:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:2.0:1789126948.804868:0:8434:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff994104b40f00 x1876035258890368/t4294967306(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:439/0 lens 504/448 e 0 to 0 dl 1789126959 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126948.804878:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994104b40f00 with x1876035258890368 ext(0->12) 00010000:00010000:2.0:1789126948.804897:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.804915:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126948.804923:0:8434:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff994104b40f00 00000100:00100000:1.0:1789126948.808359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126948.808495:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890496 00000100:00100000:0.0:1789126948.808506:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890496 00010000:00010000:0.0:1789126948.808549:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126948.808593:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1789126948.808604:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2392:x1876035258890496:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126948.808620:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789126948.808688:0:13969:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789126948.808692:0:13969:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789126948 00002000:00010000:0.0:1789126948.808694:0:13969:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789126948 00002000:00010000:0.0:1789126948.808696:0:13969:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789126948 00002000:00010000:0.0:1789126948.808699:0:13969:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789126948.808707:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.808722:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.808761:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000081508ec/0xa840b4da666eb49d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5a0 expref: 9 pid: 8429 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.808778:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126948.808783:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126948.808789:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.808800:0:13969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.808832:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126948.808904:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2392:x1876035258890496:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 301us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126948.808913:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00010000:00010000:3.0:1789126948.809045:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809054:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809074:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809083:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809090:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809097:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126948.809100:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809122:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809135:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.809144:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef49d7ee/0xa840b4da666eb4ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126948.809194:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258890240:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 11706us (11877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.809204:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:0.0:1789126948.813378:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126948.813584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890752 00000100:00100000:1.0:1789126948.813596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890752 00000100:00100000:1.0:1789126948.813695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:1.0:1789126948.813707:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212265050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:12479:x1876035258890752:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:1.0:1789126948.813780:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5bc expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126948.814235:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789126948.814270:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789126948.814551:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789126948.814588:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.814604:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.814613:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.814689:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.814704:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 30 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126948.814734:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276784512:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126948.814812:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126948.818882:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276784512:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126948.818920:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126948.820229:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.820413:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258890880 00000100:00100000:2.0:1789126948.820421:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258890880 00010000:00010000:2.0:1789126948.820462:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 31 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126948.820505:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:2.0:1789126948.820515:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+31:2393:x1876035258890880:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126948.820530:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126948.820537:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 31 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820550:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 31 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820588:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66c00/0xa840b4da666eb488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c592 expref: 31 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820605:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:2.0:1789126948.820610:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820620:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820628:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.820701:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126948.820752:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:2393:x1876035258890880:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 237us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126948.820761:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00010000:00010000:3.0:1789126948.820769:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.820780:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126948.821693:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789126948.821803:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789126948.822013:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276784640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789126948.822065:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126948.822100:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126948.822208:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276784640 00000100:00100000:1.0:1789126948.822214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276784640 00000100:00080000:3.0:1789126948.822258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126948.822276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789126948.822286:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276784640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126948.822375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276784640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126948.822383:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789126948.822510:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276784640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789126948.822619:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789126948.822714:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276784768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789126948.822756:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126948.822825:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126948.823506:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276784768 00000100:00100000:1.0:1789126948.823512:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276784768 00000100:00100000:1.0:1789126948.823583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789126948.823593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876035276784768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126948.823758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1876035276784768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (1001us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789126948.823766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789126948.823837:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276784768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789126948.823880:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789126948.823925:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823934:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823941:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823947:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126948.823951:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823958:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823973:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:0.0:1789126948.823976:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789126948.823981:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126948.823987:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb4f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789126948.824090:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789126948.824144:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789126948.824154:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374028504793ns, next at 375028502588ns, rc = 0 00000001:00080000:0.0:1789126948.824160:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789126948.824191:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994236492200) 00010000:00010000:0.0:1789126948.824195:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789126948.824201:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb4dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5bc expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126948.824286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212265050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:12479:x1876035258890752:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 10582us (10919us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789126948.824294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000020:00080000:0.0:1789126948.824298:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789126948.826960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126948.827033:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258891008 00000100:00100000:2.0:1789126948.827041:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258891008 00000100:00100000:2.0:1789126948.827099:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1789126948.827109:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+33:12479:x1876035258891008:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126948.827130:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126948.827152:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5c3 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.827202:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5c3 expref: 34 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.827232:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5c3 expref: 34 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126948.827251:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126948.827254:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789126948.827258:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:2.0:1789126948.827311:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:12479:x1876035258891008:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 204us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126948.827319:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1789126948.830573:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126948.830642:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258891264 00000100:00100000:0.0:1789126948.830687:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258891264 00000100:00100000:0.0:1789126948.830745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1789126948.830756:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:12479:x1876035258891264:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789126948.830984:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12479:x1876035258891264:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 229us (418us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789126948.830993:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1789126948.917134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126948.917357:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258891520 00000100:00100000:1.0:1789126948.917368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258891520 00000100:00100000:1.0:1789126948.917429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:1.0:1789126948.917439:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12489:x1876035258891520:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126948.917475:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126948.917495:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb4ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126948.917598:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789126948.917730:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb4ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ca expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.917755:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:1.0:1789126948.917758:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789126948.917764:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb4ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ca expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.917778:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397e00, rc 0) 00000100:00100000:1.0:1789126948.917830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:12489:x1876035258891520:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 393us (706us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789126948.917837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:2.0:1789126948.922086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.922170:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258891648 00000100:00100000:3.0:1789126948.922180:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258891648 00000100:00100000:3.0:1789126948.922240:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:3.0:1789126948.922250:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:12489:x1876035258891648:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:3.0:1789126948.922325:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922342:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922355:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922367:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922375:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922381:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922450:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922459:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922483:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126948.922531:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922545:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922551:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922558:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922564:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.922568:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922587:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922599:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126948.922602:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.922606:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922613:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb50d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922626:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922639:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922687:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922694:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.922698:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922705:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922714:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:3.0:1789126948.922717:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.922719:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922725:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922734:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922740:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922747:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922752:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126948.922761:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922768:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922777:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126948.922779:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126948.922782:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126948.922789:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb51b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126948.922856:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:12489:x1876035258891648:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 606us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126948.922864:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:2.0:1789126948.926043:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126948.926123:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258891904 00000100:00100000:3.0:1789126948.926131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258891904 00000100:00100000:3.0:1789126948.926185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789126948.926196:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+36:12489:x1876035258891904:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126948.926403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12489:x1876035258891904:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 208us (368us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789126948.926411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1789126948.997055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126948.998177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258892160 00000100:00100000:1.0:1789126948.998192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258892160 00000100:00100000:1.0:1789126948.998368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1789126948.998381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12492:x1876035258892160:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126948.998406:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126948.998427:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb522 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998831:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998864:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998876:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998900:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998908:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.998915:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.999463:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.999475:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126948.999483:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126948.999493:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789126949.001392:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001414:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001422:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001445:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126949.001451:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001459:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001476:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126949.001479:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126949.001483:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001490:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb529 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001509:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001516:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001522:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001527:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126949.001530:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001535:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001554:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:1.0:1789126949.001557:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126949.001560:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.001565:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb530 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.005460:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb522 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.005480:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.005490:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126949.005493:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126949.005497:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396e00, rc 0) 00000100:00100000:1.0:1789126949.005591:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12492:x1876035258892160:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 7212us (8545us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789126949.005600:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:2.0:1789126949.010682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126949.011071:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258892288 00000100:00100000:3.0:1789126949.011081:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258892288 00000100:00100000:3.0:1789126949.011205:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:3.0:1789126949.011215:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12492:x1876035258892288:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126949.011284:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011316:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011328:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011363:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011370:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011377:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011383:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126949.011387:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011393:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011405:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126949.011408:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126949.011412:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.011417:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126949.011494:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12492:x1876035258892288:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 279us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.011509:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00080000:1.0:1789126949.011560:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126949.017715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126949.017918:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258892544 00000100:00100000:3.0:1789126949.017928:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258892544 00000100:00100000:3.0:1789126949.017985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:3.0:1789126949.017995:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12492:x1876035258892544:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126949.018223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+40:12492:x1876035258892544:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 230us (517us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789126949.018234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789126949.282172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126949.282267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258892800 00000100:00100000:0.0:1789126949.282278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258892800 00000100:00100000:0.0:1789126949.282347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:0.0:1789126949.282357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+40:12523:x1876035258892800:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:0.0:1789126949.282380:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126949.282401:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb54c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5d8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.282504:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb553 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.282531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.282544:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126949.282557:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789126949.282711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb54c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d8 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.282729:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d8 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.282738:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126949.282742:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126949.282745:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166e00, rc 0) 00000100:00100000:0.0:1789126949.282811:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12523:x1876035258892800:12345-192.168.203.23@tcp:101:cat.0 Request processed in 454us (648us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789126949.282818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:2.0:1789126949.289473:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126949.289578:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126949.289684:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893184 00000100:00100000:1.0:1789126949.289695:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893184 00000100:00100000:1.0:1789126949.289757:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1789126949.289767:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:2392:x1876035258893184:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126949.289781:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126949.289806:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb553 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d8 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.289836:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126949.289841:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126949.289902:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:2392:x1876035258893184:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126949.289910:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1789126949.290302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893056 00000100:00100000:3.0:1789126949.290307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893056 00000100:00100000:3.0:1789126949.290343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1789126949.290350:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:12523:x1876035258893056:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:3.0:1789126949.290549:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12523:x1876035258893056:12345-192.168.203.23@tcp:35:cat.0 Request processed in 199us (1094us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789126949.290556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00010000:00010000:0.0:1789126949.291710:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126949.378322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126949.378421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893440 00000100:00100000:0.0:1789126949.378430:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893440 00000100:00100000:0.0:1789126949.378496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:0.0:1789126949.378506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12529:x1876035258893440:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:0.0:1789126949.378530:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126949.378533:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789126949.378561:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb4b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ae expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.378806:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126949.378811:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126949.378825:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb561 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.378942:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.378956:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.378963:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.378995:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.381047:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 42 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126949.381075:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276784896:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126949.381203:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126949.384420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126949.384547:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276784896:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126949.384586:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126949.389168:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893568 00000100:00100000:1.0:1789126949.389184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893568 00010000:00010000:1.0:1789126949.389237:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 43 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126949.389287:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:1.0:1789126949.389297:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:2393:x1876035258893568:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126949.389310:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126949.389317:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 43 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389330:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 43 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389352:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb537 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5d1 expref: 43 pid: 6513 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389369:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126949.389374:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389401:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389409:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.389443:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126949.389526:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:2393:x1876035258893568:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 230us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126949.389534:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00010000:00010000:0.0:1789126949.389696:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.389721:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126949.389751:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789126949.389879:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eb561 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.389905:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.389913:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126949.389915:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789126949.389918:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166c00, rc 0) 00000100:00100000:0.0:1789126949.389956:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12529:x1876035258893440:12345-192.168.203.23@tcp:101:dd.0 Request processed in 11441us (11632us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789126949.389964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:2.0:1789126949.394619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126949.394859:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893696 00000100:00100000:1.0:1789126949.394870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893696 00000100:00100000:1.0:1789126949.394939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:1.0:1789126949.395543:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12529:x1876035258893696:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:1.0:1789126949.395581:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126949.395604:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb576 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395636:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395678:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395691:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395817:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb576 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395847:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.395855:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126949.395858:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789126949.395861:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397400, rc 0) 00000100:00100000:1.0:1789126949.395941:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:12529:x1876035258893696:12345-192.168.203.23@tcp:101:dd.0 Request processed in 993us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126949.396063:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:3.0:1789126949.415608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126949.415982:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258893952 00000100:00100000:2.0:1789126949.415992:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258893952 00000100:00100000:2.0:1789126949.416061:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:2.0:1789126949.416071:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:12529:x1876035258893952:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:2.0:1789126949.416296:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.416326:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.416406:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789126949.416453:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789126949.416476:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000faadeacd reply state 000000003c3ff606 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.416488:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.416495:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126949.416498:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126949.416502:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789126949.416601:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:12529:x1876035258893952:12345-192.168.203.23@tcp:36:dd.0 Request processed in 530us (1002us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789126949.416608:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 170 00000020:00080000:2.0:1789126949.416613:0:9524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789126949.547004:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789126949.547026:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276785024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126949.547099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126949.547227:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126949.547238:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276785152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126949.547803:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276785664:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.547841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.547902:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126949.547908:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276785280:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.547938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.547987:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276785536:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.548396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.548419:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126949.548425:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276785408:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.548448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.548493:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785536 00000100:00100000:0.0:1789126949.548501:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785536 00000100:00100000:0.0:1789126949.548549:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789126949.548558:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276785536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.548614:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276785536:12345-0@lo:400:kworker.0 Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.548621:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789126949.548677:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276785536:0@lo:400:kworker.0 00000100:00100000:1.0:1789126949.548990:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785280 00000100:00100000:1.0:1789126949.548995:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785280 00000100:00100000:1.0:1789126949.549258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789126949.549265:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276785280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.549918:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785664 00000100:00100000:0.0:1789126949.549923:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785664 00000100:00100000:3.0:1789126949.549989:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276785920:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.550031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785408 00000100:00100000:0.0:1789126949.550036:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785408 00000100:00100000:3.0:1789126949.550044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.550071:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276786432:0@lo:400:kworker.0 00000100:00100000:1.0:1789126949.550085:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276785280:12345-0@lo:400:kworker.0 Request processed in 40us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.550098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126949.550212:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789126949.550256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.551083:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789126949.551106:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276786048:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.551142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.551196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785920 00000100:00100000:0.0:1789126949.551203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785920 00000100:00100000:3.0:1789126949.551211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276786560:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.551239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126949.551254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786432 00000100:00100000:0.0:1789126949.551258:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786432 00000100:00100000:0.0:1789126949.551278:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786048 00000100:00100000:0.0:1789126949.551280:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786048 00000100:00100000:3.0:1789126949.551283:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786560 00000100:00100000:3.0:1789126949.551288:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786560 00000100:00100000:0.0:1789126949.551314:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789126949.551329:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276785664:12345-0@lo:400:kworker.0 Request processed in 53us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.551382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789126949.551390:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789126949.551399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789126949.551404:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276786560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551410:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276785408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551460:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276785408:12345-0@lo:400:kworker.0 Request processed in 53us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.551466:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276786560:12345-0@lo:400:kworker.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.551471:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789126949.551477:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789126949.551501:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789126949.551509:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.551527:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104101a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276786560:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551548:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276785920:12345-0@lo:400:kworker.0 Request processed in 40us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.551553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276785920:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789126949.551577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789126949.551587:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276786432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.551615:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789126949.551625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276786432:12345-0@lo:400:kworker.0 Request processed in 40us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.551627:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276786048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.551638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:0.0:1789126949.551690:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030770c0 x1876035276786432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126949.551702:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276786048:12345-0@lo:400:kworker.0 Request processed in 78us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.551703:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276786432:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.551715:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00080000:0.0:1789126949.551731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104b43480 x1876035276786048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126949.551740:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276786048:0@lo:400:kworker.0 00000100:00080000:0.0:1789126949.551776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126949.551781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126949.551782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126949.552074:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276785408:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552097:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276786176:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.552153:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276786688:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.552197:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276785280:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552222:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276785664:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552236:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789126949.552241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276785792:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.552279:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126949.552314:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786176 00000100:00100000:3.0:1789126949.552318:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786176 00000100:00100000:3.0:1789126949.552418:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786688 00000100:00100000:3.0:1789126949.552421:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786688 00000100:00100000:3.0:1789126949.552439:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789126949.552444:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276786176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552477:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276786176:12345-0@lo:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.552483:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789126949.552494:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789126949.552499:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276786688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552519:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276786688:12345-0@lo:400:kworker.0 Request processed in 20us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.552524:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789126949.552546:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276786176:0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552555:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276786688:0@lo:400:kworker.0 00000100:00080000:0.0:1789126949.552717:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126949.552721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126949.552731:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276786304 00000100:00100000:0.0:1789126949.552735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276786304 00000100:00100000:0.0:1789126949.552784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789126949.552792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276786304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.552830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276786304:12345-0@lo:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.552845:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789126949.552874:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785792 00000100:00100000:0.0:1789126949.552877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785792 00000100:00080000:3.0:1789126949.552916:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126949.552917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789126949.552929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276785792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126949.552943:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276786304:0@lo:400:kworker.0 00000100:00100000:0.0:1789126949.552990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276785792:12345-0@lo:400:kworker.0 Request processed in 63us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126949.552996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789126949.553014:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276785792:0@lo:400:kworker.0 00000100:00100000:2.0:1789126949.554666:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785024 00000100:00100000:3.0:1789126949.554669:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276785152 00000100:00100000:3.0:1789126949.554678:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785152 00000100:00100000:2.0:1789126949.554678:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276785024 00000100:00100000:3.0:1789126949.554791:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789126949.554801:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276785152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126949.554833:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789126949.554924:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789126949.554932:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276785024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126949.554943:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789126949.555291:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276785024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 359us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126949.555300:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789126949.555318:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276785152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 517us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.555326:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789126949.555443:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276785152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126949.555623:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276785024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126949.676437:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126949.676595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258894080 00000100:00100000:0.0:1789126949.676608:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258894080 00000100:00100000:0.0:1789126949.676722:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:0.0:1789126949.676735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:12543:x1876035258894080:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:0.0:1789126949.676768:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126949.676794:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb58b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676875:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676904:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676918:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676931:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676951:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.676958:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.677412:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.677426:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.677437:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.677482:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126949.677498:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 47 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126949.677515:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276786816:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126949.678171:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789126949.681706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126949.681873:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276786816:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126949.681920:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126949.682588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258894336 00000100:00100000:3.0:1789126949.682597:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258894336 00000100:00100000:3.0:1789126949.682746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1789126949.682758:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+48:6158:x1876035258894336:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789126949.683209:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:6158:x1876035258894336:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 452us (1561us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789126949.683218:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1789126949.688905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126949.689131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258894464 00000100:00100000:3.0:1789126949.689143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258894464 00010000:00010000:3.0:1789126949.689194:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 49 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126949.689239:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:3.0:1789126949.689250:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942108ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:2393:x1876035258894464:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126949.689272:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126949.689280:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 49 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689311:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 49 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689337:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb568 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5df expref: 49 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689354:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126949.689360:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689371:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689379:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689407:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126949.689466:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942108ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+48:2393:x1876035258894464:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 217us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.689473:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00010000:00010000:3.0:1789126949.689531:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689539:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126949.689600:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789126949.689605:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126949.689628:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689677:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689688:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689695:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689702:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689708:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126949.689712:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689720:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689740:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126949.689743:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126949.689747:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666eb592 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689763:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689770:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689781:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689786:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126949.689789:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689795:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689802:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:3.0:1789126949.689804:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126949.689806:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689812:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eb599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689844:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb58b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ed expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689857:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ed expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.689864:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126949.689867:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126949.689869:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167600, rc 0) 00000100:00100000:3.0:1789126949.692136:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:12543:x1876035258894080:12345-192.168.203.23@tcp:101:stat.0 Request processed in 15388us (15701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126949.692168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:0.0:1789126949.758425:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126949.758645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258894720 00000100:00100000:2.0:1789126949.758797:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258894720 00000100:00100000:2.0:1789126949.758875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:2.0:1789126949.758897:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:12549:x1876035258894720:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:2.0:1789126949.758974:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126949.759132:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb5a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5ed expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.759154:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126949.759160:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126949.759385:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.759402:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.759412:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789126949.759458:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789126949.759480:0:6512:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000042d91d5d reply state 00000000944daa48 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.759495:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126949.759523:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126949.759526:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126949.759529:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789126949.759931:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:12549:x1876035258894720:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 1035us (1518us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789126949.759940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000020:00080000:2.0:1789126949.759947:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789126949.893013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126949.893542:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258894848 00000100:00100000:1.0:1789126949.893565:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258894848 00000100:00100000:1.0:1789126949.893673:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1789126949.893685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+49:12563:x1876035258894848:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:1.0:1789126949.893740:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126949.893770:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb5ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893860:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893889:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893907:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893920:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893927:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.893934:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894041:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894050:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894057:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126949.894112:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789126949.894123:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126949.894151:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894176:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894183:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894191:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894197:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126949.894202:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894212:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894228:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126949.894232:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126949.894237:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894244:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb5b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894260:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894277:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894283:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894287:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126949.894291:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894297:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894305:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:1.0:1789126949.894307:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126949.894310:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894316:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb5bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894349:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb5ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894364:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126949.894372:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126949.894375:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126949.894383:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396800, rc 0) 00000100:00100000:1.0:1789126949.894477:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:12563:x1876035258894848:12345-192.168.203.23@tcp:101:stat.0 Request processed in 793us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126949.894486:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:1.0:1789126949.962033:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126949.965924:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258895104 00000100:00100000:3.0:1789126949.965940:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258895104 00000100:00100000:3.0:1789126949.966020:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:3.0:1789126949.966030:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+50:12573:x1876035258895104:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126949.966051:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126949.966071:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb5ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c5fb expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126949.966169:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789126949.966265:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb5ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5fb expref: 52 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.966278:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:3.0:1789126949.966281:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126949.966285:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb5ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5fb expref: 52 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126949.966298:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67e00, rc 0) 00000100:00100000:3.0:1789126949.966375:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:12573:x1876035258895104:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 346us (4349us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789126949.966382:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:0.0:1789126949.969873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126949.970065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258895360 00000100:00100000:2.0:1789126949.970073:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258895360 00000100:00100000:2.0:1789126949.970168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1789126949.970179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212265c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+51:12573:x1876035258895360:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1789126949.970432:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212265c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:12573:x1876035258895360:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 254us (568us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789126949.970441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:1.0:1789126950.031759:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.032202:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258895616 00000100:00100000:0.0:1789126950.032226:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258895616 00000100:00100000:0.0:1789126950.032291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:0.0:1789126950.032301:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:12579:x1876035258895616:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789126950.032324:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126950.032462:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb5d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c602 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.032577:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.032592:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.032602:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.032635:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.032708:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 53 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126950.032722:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410415b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276786944:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126950.032867:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520900 going to sleep for 11 seconds 00000100:00100000:1.0:1789126950.038923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.039390:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258895744 00000100:00100000:2.0:1789126950.039400:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258895744 00010000:00010000:2.0:1789126950.039446:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 54 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126950.039491:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:2.0:1789126950.039501:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:2394:x1876035258895744:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126950.039515:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126950.039521:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 54 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.039554:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 54 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.039579:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126950.039585:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.039594:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.039601:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.039619:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126950.039709:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:2394:x1876035258895744:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 209us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.039717:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00010000:00010000:0.0:1789126950.041583:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb5c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5f4 expref: 53 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126950.041612:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410415b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276786944:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126950.041770:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.041781:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.041787:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126950.041809:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789126950.042721:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb5d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.042743:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.042752:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126950.042755:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789126950.042759:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166200, rc 0) 00000100:00100000:0.0:1789126950.043009:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:12579:x1876035258895616:12345-192.168.203.23@tcp:101:bash.0 Request processed in 10708us (11255us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789126950.043018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:1.0:1789126950.053248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.053352:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896000 00000100:00100000:3.0:1789126950.053364:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896000 00000100:00100000:3.0:1789126950.053439:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:3.0:1789126950.053450:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+53:12579:x1876035258896000:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:3.0:1789126950.053816:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.053839:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.053853:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126950.053913:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789126950.053937:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d96cf7af reply state 00000000b0234427 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.053951:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.053960:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126950.053963:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126950.053968:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126950.054085:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12579:x1876035258896000:12345-192.168.203.23@tcp:36:bash.0 Request processed in 636us (978us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789126950.054093:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 176 00000020:00080000:3.0:1789126950.054099:0:9524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789126950.060431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.067979:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896128 00000100:00100000:2.0:1789126950.068000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896128 00000100:00100000:2.0:1789126950.068387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:2.0:1789126950.068401:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12579:x1876035258896128:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126950.068432:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126950.068461:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb5f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c609 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.068578:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.068618:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.068630:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.068699:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.068715:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 57 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126950.068739:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104a50b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276787072:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126950.068887:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789126950.075719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.075963:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896256 00000100:00100000:0.0:1789126950.075974:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896256 00010000:00010000:0.0:1789126950.076042:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 58 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126950.076142:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:0.0:1789126950.076153:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:2393:x1876035258896256:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126950.076182:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126950.076190:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 58 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.076206:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 58 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.076235:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126950.076241:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.076253:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.076262:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.076284:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126950.076359:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:2393:x1876035258896256:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 206us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126950.076366:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00010000:00010000:2.0:1789126950.077046:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb5df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c602 expref: 57 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126950.077068:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104a50b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276787072:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126950.077092:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.077104:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.077120:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126950.077192:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789126950.077206:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126950.077231:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.077267:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb5f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c609 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.077285:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c609 expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.077294:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126950.077297:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126950.077300:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126950.077355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12579:x1876035258896128:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8957us (16938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.077364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:3.0:1789126950.086640:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.086702:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896512 00000100:00100000:3.0:1789126950.086714:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896512 00000100:00100000:3.0:1789126950.086787:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1789126950.086801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12579:x1876035258896512:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1789126950.087314:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:12579:x1876035258896512:12345-192.168.203.23@tcp:35:bash.0 Request processed in 513us (684us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789126950.087344:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1789126950.151998:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.152110:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896768 00000100:00100000:3.0:1789126950.152122:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896768 00000100:00100000:3.0:1789126950.152204:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:3.0:1789126950.152217:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+57:12589:x1876035258896768:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126950.152248:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126950.152274:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c610 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126950.152402:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789126950.152546:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb602 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c610 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.152564:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:3.0:1789126950.152567:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126950.152574:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c610 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.152591:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67e00, rc 0) 00000100:00100000:3.0:1789126950.152731:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12589:x1876035258896768:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 516us (748us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789126950.152740:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:1.0:1789126950.158755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.158851:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258896896 00000100:00100000:0.0:1789126950.158863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258896896 00000100:00100000:0.0:1789126950.158956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 179 00000100:00100000:0.0:1789126950.158968:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12589:x1876035258896896:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1789126950.159101:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159123:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159146:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159161:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159169:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159176:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159270:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159280:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159288:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126950.159347:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159362:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159369:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159376:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159393:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126950.159398:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159407:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159421:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126950.159425:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126950.159430:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159436:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666eb610 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159450:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159456:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159461:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159466:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126950.159469:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159474:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159505:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:0.0:1789126950.159508:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126950.159511:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159517:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb617 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159527:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159533:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159539:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159545:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126950.159547:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159553:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159559:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126950.159562:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126950.159564:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.159569:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb61e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126950.159728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12589:x1876035258896896:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 760us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126950.159737:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 179 00000100:00100000:2.0:1789126950.165032:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.165589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258897152 00000100:00100000:0.0:1789126950.165602:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258897152 00000100:00100000:0.0:1789126950.165706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1789126950.165719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12589:x1876035258897152:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789126950.166190:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12589:x1876035258897152:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 472us (1172us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789126950.166201:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1789126950.197205:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.197371:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258897408 00000100:00100000:3.0:1789126950.197384:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258897408 00000100:00100000:3.0:1789126950.197459:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:3.0:1789126950.197471:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12592:x1876035258897408:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126950.197533:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126950.197561:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb625 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c617 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197720:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197749:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197763:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197776:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197783:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.197790:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198118:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67000/0xa840b4da666eb63a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198130:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67000/0xa840b4da666eb63a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198137:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67000/0xa840b4da666eb63a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126950.198151:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789126950.198265:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198274:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198281:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198287:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126950.198292:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198301:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198316:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126950.198319:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126950.198324:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198331:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb62c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198345:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198351:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198357:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198362:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126950.198370:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198377:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198383:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:3.0:1789126950.198386:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126950.198389:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198394:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198446:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb625 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c617 expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198461:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67000/0xa840b4da666eb63a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c617 expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.198469:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126950.198472:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126950.198531:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67000, rc 0) 00000100:00100000:3.0:1789126950.198789:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:12592:x1876035258897408:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1319us (1598us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789126950.198799:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:1.0:1789126950.205163:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.205462:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.205633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258897536 00000100:00100000:2.0:1789126950.205738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258897536 00000100:00100000:2.0:1789126950.205817:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:2.0:1789126950.205830:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:12592:x1876035258897536:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1789126950.205933:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.205955:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.205968:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206174:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206184:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206192:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206199:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.206204:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206213:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206227:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126950.206231:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126950.206236:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.206243:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb648 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126950.206388:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:12592:x1876035258897536:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 559us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.206396:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:0.0:1789126950.206581:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258897664 00000100:00100000:0.0:1789126950.206588:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258897664 00000100:00100000:3.0:1789126950.208038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.208258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258897920 00000100:00100000:1.0:1789126950.208267:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258897920 00000100:00100000:1.0:1789126950.208326:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1789126950.208337:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:12592:x1876035258897920:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789126950.208582:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1789126950.208593:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:2392:x1876035258897664:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126950.208606:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789126950.208613:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12592:x1876035258897920:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 278us (584us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789126950.208621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00010000:00010000:0.0:1789126950.208634:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67000/0xa840b4da666eb63a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c617 expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.208665:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126950.208671:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126950.208692:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:2392:x1876035258897664:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 102us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126950.208699:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:0.0:1789126950.315113:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126950.367093:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.367253:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258898176 00000100:00100000:3.0:1789126950.367264:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258898176 00000100:00100000:3.0:1789126950.367347:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:3.0:1789126950.367376:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+61:12610:x1876035258898176:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1789126950.367407:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126950.367433:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb64f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c61e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.367574:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb656 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.367594:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb656 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.367608:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb656 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126950.367787:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789126950.367932:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb64f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c61e expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.367956:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb656 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c61e expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.367966:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126950.367969:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789126950.367973:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66600, rc 0) 00000100:00100000:3.0:1789126950.368069:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12610:x1876035258898176:12345-192.168.203.23@tcp:101:cat.0 Request processed in 693us (990us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789126950.368077:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:1.0:1789126950.399736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.399855:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258898304 00000100:00100000:0.0:1789126950.399899:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258898304 00000100:00100000:0.0:1789126950.399995:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:0.0:1789126950.400007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12611:x1876035258898304:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126950.400039:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126950.400065:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c625 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400150:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400169:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400183:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126950.400356:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789126950.400362:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126950.400387:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400421:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eb664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c625 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400442:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c625 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.400453:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126950.400456:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126950.400461:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166200, rc 0) 00000100:00100000:0.0:1789126950.400547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12611:x1876035258898304:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 542us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126950.400556:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:2.0:1789126950.408849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.408926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258898688 00000100:00100000:1.0:1789126950.408940:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258898688 00000100:00100000:1.0:1789126950.409030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1789126950.409043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12611:x1876035258898688:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126950.409612:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12611:x1876035258898688:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 569us (775us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789126950.409746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:2.0:1789126950.417531:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.418105:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258898816 00000100:00100000:1.0:1789126950.418188:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258898816 00000100:00100000:1.0:1789126950.418317:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789126950.418330:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12611:x1876035258898816:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:1.0:1789126950.418350:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789126950.418380:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb5fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c609 expref: 65 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.418406:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666eb656 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c61e expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.418421:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb4f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5c3 expref: 63 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.418432:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126950.418438:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126950.418512:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:12611:x1876035258898816:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 184us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126950.418520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1789126950.431538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.431770:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258898944 00000100:00100000:3.0:1789126950.431784:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258898944 00000100:00100000:3.0:1789126950.431888:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:3.0:1789126950.431900:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:12611:x1876035258898944:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:3.0:1789126950.432076:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.432099:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126950.432114:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789126950.432382:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789126950.432494:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:12611:x1876035258898944:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 595us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126950.432503:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:2.0:1789126950.458526:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.458606:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899072 00000100:00100000:3.0:1789126950.458619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899072 00000100:00100000:2.0:1789126950.458849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:2.0:1789126950.458863:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+62:12613:x1876035258899072:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126950.458924:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126950.459054:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb679 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c62c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459142:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459160:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459174:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459186:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459192:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459196:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459320:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459327:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459331:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126950.459392:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789126950.459396:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126950.459415:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459431:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459436:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459442:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459449:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.459454:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459461:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459475:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126950.459479:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126950.459484:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459491:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459517:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459524:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459530:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459536:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.459539:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459545:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459554:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:2.0:1789126950.459556:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126950.459560:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459595:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb679 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459609:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.459627:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126950.459629:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126950.459632:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126950.459860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12613:x1876035258899072:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1000us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.459870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 185 00000040:00080000:3.0:1789126950.827916:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126950.827931:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126950.828015:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789126950.828029:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126950.828902:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048cf0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276787200:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789126950.830583:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213befe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789126950.831922:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048cf0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276787200:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789126950.834426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.838949:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899200 00000100:00100000:1.0:1789126950.838973:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899200 00000100:00100000:1.0:1789126950.839864:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:1.0:1789126950.839896:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12624:x1876035258899200:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126950.839937:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126950.840108:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12624:x1876035258899200:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 232us (5702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126950.842852:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:0.0:1789126950.854586:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.855187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899328 00000100:00100000:2.0:1789126950.855202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899328 00000100:00100000:2.0:1789126950.855291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:2.0:1789126950.855304:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12624:x1876035258899328:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789126950.855401:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855423:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855441:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855464:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855472:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855480:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855811:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855823:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.855832:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126950.856087:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789126950.856094:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126950.856112:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856125:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856133:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856140:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856147:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.856152:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856160:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856175:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:2.0:1789126950.856185:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126950.856192:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856199:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb695 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856215:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856221:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856226:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856232:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.856234:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856240:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856248:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff994103ea9c00) 00010000:00010000:2.0:1789126950.856251:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126950.856253:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856259:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb69c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856279:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856291:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856297:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856302:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126950.856305:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856310:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:2.0:1789126950.856320:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126950.856323:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.856329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb6a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126950.856429:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410415b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12624:x1876035258899328:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 1126us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.856439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:2.0:1789126950.869863:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126950.869987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899584 00000100:00100000:0.0:1789126950.870001:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899584 00000100:00100000:0.0:1789126950.870110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:0.0:1789126950.870124:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12624:x1876035258899584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126950.870156:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126950.870188:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c633 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870345:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870365:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870380:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126950.870395:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789126950.870514:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870525:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870533:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870553:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126950.870559:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870569:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870585:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126950.870589:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789126950.870596:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eb6b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870691:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c633 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870704:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:0.0:1789126950.870707:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789126950.870711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c633 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.870723:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167600, rc 0) 00000100:00100000:0.0:1789126950.870922:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258899584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 801us (1073us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789126950.870932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:0.0:1789126950.874325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.874590:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899712 00000100:00100000:1.0:1789126950.874603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899712 00000100:00100000:1.0:1789126950.874721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:1.0:1789126950.874734:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258899712:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126950.874781:0:6513:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126950.875010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258899712:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 264us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126950.875020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:2.0:1789126950.880576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.884148:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258899968 00000100:00100000:1.0:1789126950.884170:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258899968 00000100:00100000:1.0:1789126950.884271:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:1.0:1789126950.884283:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258899968:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126950.884309:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126950.884313:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789126950.884359:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166200/0xa840b4da666eb66b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c625 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.886092:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126950.886105:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126950.886133:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb6bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c63a expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789126950.888038:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789126950.888271:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.888294:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.888309:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.888394:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eb6bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c63a expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.888417:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c63a expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126950.888428:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994102e04d00) 00010000:00010000:0.0:1789126950.888432:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126950.888436:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167600, rc 0) 00000100:00100000:0.0:1789126950.888534:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12624:x1876035258899968:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4253us (7971us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789126950.888546:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:3.0:1789126950.893250:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.898192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258900224 00000100:00100000:1.0:1789126950.898213:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258900224 00000100:00100000:1.0:1789126950.899179:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:1.0:1789126950.899200:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12624:x1876035258900224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126950.899278:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126950.899311:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666eb6c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c63a expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899330:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994102e04d00) 00010000:00010000:1.0:1789126950.899341:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126950.899369:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899386:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899397:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899411:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899417:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899424:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899477:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899484:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899501:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899508:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126950.899512:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899520:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126950.899533:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126950.899537:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899543:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899552:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899558:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899564:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899570:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126950.899573:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899587:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899594:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa5cf0e03 (ffff99420b04ad00) 00010000:00010000:1.0:1789126950.899596:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126950.899599:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.899604:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6db lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa5cf0e03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126950.899731:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258900224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 533us (6493us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126950.899739:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:3.0:1789126950.908100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.919428:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258900352 00000100:00100000:2.0:1789126950.919460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258900352 00000100:00100000:2.0:1789126950.919562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:2.0:1789126950.919575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12624:x1876035258900352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126950.919626:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126950.919674:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb6e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c641 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919725:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919742:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919755:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919905:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb6e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919926:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 65 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.919936:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126950.919939:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789126950.919943:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030c00, rc 0) 00000100:00100000:2.0:1789126950.921217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12624:x1876035258900352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1632us (13118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.921238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:3.0:1789126950.936374:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.940308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258900608 00000100:00100000:1.0:1789126950.940330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258900608 00000100:00100000:1.0:1789126950.940427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:1.0:1789126950.940440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12624:x1876035258900608:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126950.940547:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.940568:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.940582:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789126950.940821:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789126950.940833:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376145183139ns, next at 377145179854ns, rc = 0 00000004:00010000:1.0:1789126950.940923:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000046201fad reply state 000000007c70882b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.940938:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.940957:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:1.0:1789126950.940960:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789126950.940966:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126950.941103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12624:x1876035258900608:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 664us (4744us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789126950.941112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:0.0:1789126950.952264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126950.952853:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258900736 00000100:00100000:1.0:1789126950.952868:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258900736 00000100:00100000:1.0:1789126950.952974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:1.0:1789126950.952987:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12624:x1876035258900736:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126950.953030:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126950.953067:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c648 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.953152:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.953176:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126950.953201:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:1.0:1789126950.953209:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126950.953222:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396400, rc 0) 00000100:00100000:1.0:1789126950.953308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12624:x1876035258900736:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 323us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126950.953318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:2.0:1789126950.959613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.959719:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258900864 00000100:00100000:3.0:1789126950.959739:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258900864 00000100:00100000:3.0:1789126950.959824:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1789126950.959837:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+6:2393:x1876035258900864:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789126950.960143:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258900864:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 309us (546us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789126950.960149:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00080000:2.0:1789126950.961372:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126950.968339:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.969017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258901120 00000100:00100000:3.0:1789126950.969030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258901120 00000100:00100000:3.0:1789126950.969107:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1789126950.969121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12624:x1876035258901120:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789126950.969414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+69:12624:x1876035258901120:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 296us (1091us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789126950.969423:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1789126950.973738:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126950.974224:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258901376 00000100:00100000:3.0:1789126950.974236:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258901376 00000100:00100000:3.0:1789126950.974315:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:3.0:1789126950.974328:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+69:12624:x1876035258901376:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789126950.974581:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+69:12624:x1876035258901376:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 254us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126950.974591:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:3.0:1789126950.981071:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126950.981511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258901504 00000100:00100000:2.0:1789126950.981524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258901504 00000100:00100000:2.0:1789126950.981640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:2.0:1789126950.981672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+69:12624:x1876035258901504:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126950.981701:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126950.981727:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb6fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c64f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.981815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.981834:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.981847:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126950.981912:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126950.981938:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.981974:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb6fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c64f expref: 71 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.981994:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c64f expref: 70 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126950.982004:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126950.982007:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789126950.982013:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:2.0:1789126950.982111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12624:x1876035258901504:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 461us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126950.982120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:3.0:1789126951.001127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.002595:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258901632 00000100:00100000:0.0:1789126951.002610:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258901632 00000100:00100000:0.0:1789126951.002692:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1789126951.002704:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258901632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126951.002730:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126951.002755:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c656 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789126951.002792:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3e926, blocks: 0x0 00010000:00010000:0.0:1789126951.002817:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1789126951.002822:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.002833:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.002857:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.002886:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166000, rc 0) 00000100:00100000:0.0:1789126951.003042:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258901632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 338us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.003051:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1789126951.006057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.006125:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258901888 00000100:00100000:2.0:1789126951.006135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258901888 00000100:00100000:2.0:1789126951.006217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:2.0:1789126951.006228:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12624:x1876035258901888:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789126951.006348:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12624:x1876035258901888:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.006356:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00080000:3.0:1789126951.006416:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789126951.017170:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.018729:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902016 00000100:00100000:0.0:1789126951.018748:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902016 00000100:00100000:0.0:1789126951.018827:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1789126951.018840:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:12624:x1876035258902016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126951.018865:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126951.018901:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c65d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.018941:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.018974:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.018979:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.018987:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.019031:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.019047:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.019063:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276787328:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126951.019198:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520780 going to sleep for 11 seconds 00000100:00100000:3.0:1789126951.022003:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.022134:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276787328:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126951.022179:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.022207:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166c00, rc 0) 00000100:00100000:0.0:1789126951.022278:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:12624:x1876035258902016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3439us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.022288:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:2.0:1789126951.027800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902144 00000100:00100000:2.0:1789126951.027817:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902144 00010000:00010000:3.0:1789126951.027969:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.028031:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1789126951.028043:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258902144:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126951.028062:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126951.028087:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.028103:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.028132:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052d43a65/0xa840b4da666eb70c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c656 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.028152:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.028157:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.028167:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.028177:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.028222:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.028238:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1876035276787456:192.168.203.23@tcp:105: 00000100:00100000:3.0:1789126951.028361:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef300 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.032141:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1876035276787456:192.168.203.23@tcp:105: 00010000:00010000:0.0:1789126951.032179:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126951.032266:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258902144:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 4224us (10277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.032280:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:1.0:1789126951.046002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.046094:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902272 00000100:00100000:2.0:1789126951.046107:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902272 00002000:00100000:2.0:1789126951.046176:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9941043fe940 x1876035258902272/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:442/0 lens 504/0 e 0 to 0 dl 1789126962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126951.046191:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fe940 with x1876035258902272 ext(0->8) 00002000:00010000:2.0:1789126951.046199:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941043fe940 00000100:00100000:2.0:1789126951.046243:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1789126951.046255:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258902272:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789126951.047296:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2393:x1876035258902272:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 1035us (1299us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789126951.047311:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00002000:00100000:2.0:1789126951.047323:0:8433:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9941043fe940 x1876035258902272/t4294967315(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:442/0 lens 504/448 e 0 to 0 dl 1789126962 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126951.047350:0:8433:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fe940 with x1876035258902272 ext(0->8) 00002000:00010000:2.0:1789126951.047357:0:8433:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941043fe940 00000100:00100000:3.0:1789126951.060066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.060245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902400 00000100:00100000:1.0:1789126951.060255:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902400 00000100:00100000:1.0:1789126951.060315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:1.0:1789126951.060326:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12624:x1876035258902400:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789126951.062526:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1789126951.062544:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1789126951.062599:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789126951.062619:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994213bef840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789126951.062625:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994203e61e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994213bef540 00000020:00080000:1.0:1789126951.062628:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994203e61b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99423661c200 00000020:00080000:1.0:1789126951.062687:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789126951.062743:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789126951.062880:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12624:x1876035258902400:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 2544us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126951.062892:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:3.0:1789126951.063146:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126951.063162:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276787584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789126951.063214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126951.063275:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276787584 00000100:00100000:3.0:1789126951.063281:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276787584 00000100:00100000:3.0:1789126951.063327:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789126951.063335:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276787584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789126951.063358:0:8429:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1789126951.063388:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3e924, atime: 0x6aa3e924, ctime: 0x6aa3e924, blocks: 0x8 00010000:00010000:3.0:1789126951.063397:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063412:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1789126951.063417:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.063423:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063440:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063450:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063457:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063494:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789126951.063612:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276787584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (397us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789126951.063620:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:3.0:1789126951.063641:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789126951.063677:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063686:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126951.063690:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063700:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063717:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063726:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb71a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.063744:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126951.063746:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126951.063748:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789126951.063776:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104b40000/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789126951.063782:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276787584:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789126951.063802:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126951.064449:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789126951.064463:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276787712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789126951.064504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126951.064616:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276787712 00000100:00100000:2.0:1789126951.064622:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276787712 00000100:00100000:2.0:1789126951.064701:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789126951.064711:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276787712:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789126951.065080:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789126951.065093:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065103:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065109:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065115:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc193f4f0) 00002000:00010000:2.0:1789126951.065119:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:0.0:1789126951.065119:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126951.065122:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789126950 00002000:00010000:2.0:1789126951.065125:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789126951.065127:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789126950 -> 1789126950 00010000:00010000:0.0:1789126951.065127:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126951.065129:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789126951.065140:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994103ea9100) 00010000:00010000:0.0:1789126951.065143:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065147:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065153:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb43b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065171:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065177:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065198:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065203:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc193f4f0) 00000100:00100000:2.0:1789126951.065207:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276787712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 498us (701us total) trans 4294967316 rc 0/0 00010000:00010000:0.0:1789126951.065207:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065213:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.065215:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1789126951.065222:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126951.065224:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065227:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065233:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb442 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065246:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065252:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065258:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065263:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.065265:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789126951.065275:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104a53c00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789126951.065280:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104a53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276787712:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789126951.065281:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065290:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236492300) 00010000:00010000:0.0:1789126951.065292:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065295:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065302:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66000/0xa840b4da666eb481 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065317:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065324:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065329:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065334:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.065337:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065343:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065350:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126951.065352:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065355:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065454:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb584 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065467:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065471:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065476:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065480:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.065483:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065488:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065496:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126951.065498:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065501:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065506:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb5a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065514:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065519:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065530:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065534:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.065536:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065542:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065549:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126951.065551:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.065554:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065559:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67800/0xa840b4da666eb5ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065570:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065576:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065581:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065585:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.065587:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065601:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065609:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:0.0:1789126951.065611:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789126951.065614:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.065618:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb6f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.067487:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.067573:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902528 00000100:00100000:0.0:1789126951.067581:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902528 00000100:00100000:0.0:1789126951.067690:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1789126951.067701:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2393:x1876035258902528:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789126951.069168:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1789126951.069178:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1789126951.069324:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258902528:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 1620us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.069335:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:1.0:1789126951.072929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.073164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902784 00000100:00100000:2.0:1789126951.073174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902784 00000100:00100000:2.0:1789126951.073227:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1789126951.073236:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12624:x1876035258902784:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789126951.073283:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126951.073308:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666eb705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c64f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.073326:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126951.073343:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126951.073384:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.073398:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.073408:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126951.073512:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000030a07851 reply state 000000001d761bf8 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.073523:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.073529:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126951.073532:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789126951.073534:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789126951.073620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:12624:x1876035258902784:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 384us (708us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789126951.073628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:1.0:1789126951.077271:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.077393:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258902912 00000100:00100000:2.0:1789126951.077401:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258902912 00000100:00100000:2.0:1789126951.077454:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:2.0:1789126951.077462:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258902912:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789126951.077578:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789126951.077580:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789126950 -> 1789126949 00002000:00010000:2.0:1789126951.077582:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789126948 00002000:00010000:2.0:1789126951.077584:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789126950 -> 1789126949 00002000:00010000:2.0:1789126951.077596:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789126951.077643:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258902912:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 181us (381us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789126951.077678:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1789126951.081238:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.081326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903168 00000100:00100000:2.0:1789126951.081334:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903168 00000100:00100000:2.0:1789126951.081395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:2.0:1789126951.081405:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:12624:x1876035258903168:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789126951.081480:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.081497:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.081507:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.081538:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.081554:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 20 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.081569:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104960b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276787840:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126951.081687:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126951.085259:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104960b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276787840:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126951.085289:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.086787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.087098:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903296 00000100:00100000:0.0:1789126951.087106:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903296 00010000:00010000:0.0:1789126951.087144:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 21 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.087184:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:0.0:1789126951.087194:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:2394:x1876035258903296:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126951.087208:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126951.087215:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 21 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087240:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 21 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087262:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666eb6e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c641 expref: 21 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087278:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:0.0:1789126951.087283:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087292:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087300:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.087331:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126951.087393:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:2394:x1876035258903296:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 199us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.087400:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00010000:00010000:2.0:1789126951.087684:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087692:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087731:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087739:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087745:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087751:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.087756:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087764:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087774:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126951.087777:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789126951.087780:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.087786:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb728 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.087839:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12624:x1876035258903168:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 6435us (6609us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789126951.087854:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:3.0:1789126951.096595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.096688:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903424 00000100:00100000:0.0:1789126951.096698:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903424 00000100:00100000:0.0:1789126951.096751:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:0.0:1789126951.096761:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258903424:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789126951.096803:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.096834:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.096844:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.096848:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789126951.096853:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.096896:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.096910:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 8 pid: 8430 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.096925:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276787968:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126951.096994:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520780 going to sleep for 11 seconds 00000100:00100000:2.0:1789126951.100909:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876035276787968:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126951.100937:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.104566:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.104622:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903552 00000100:00100000:1.0:1789126951.104634:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903552 00010000:00010000:1.0:1789126951.104786:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.104840:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:1.0:1789126951.104850:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258903552:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126951.104864:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126951.104895:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.104908:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.104930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beedc96c/0xa840b4da666eb713 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c65d expref: 9 pid: 8430 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.104944:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126951.104948:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126951.104953:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.104962:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.105560:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126951.105563:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105576:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105598:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105607:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105615:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.105624:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258903552:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 774us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126951.105640:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00010000:00010000:3.0:1789126951.105642:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126951.105670:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105686:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105702:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.105709:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4ff09f/0xa840b4da666eb72f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.105826:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258903424:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 9065us (9239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.105834:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1789126951.108350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.108828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903808 00000100:00100000:1.0:1789126951.108837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903808 00000100:00100000:1.0:1789126951.108893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:1.0:1789126951.108902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12624:x1876035258903808:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789126951.108989:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.109005:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.109015:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.109045:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.109060:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 19 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.109074:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788096:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126951.109148:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789126951.113049:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.113109:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258903936 00000100:00100000:0.0:1789126951.113117:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258903936 00010000:00010000:0.0:1789126951.113153:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.113188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:0.0:1789126951.113197:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:2393:x1876035258903936:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126951.113211:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126951.113218:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.113237:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.113259:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:0.0:1789126951.113264:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.113274:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.113281:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.113298:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126951.113347:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:2393:x1876035258903936:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.113354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00010000:00010000:2.0:1789126951.113911:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397400/0xa840b4da666eb57d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c5e6 expref: 19 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.113926:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788096:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126951.113946:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.113955:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.113961:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.114173:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.114185:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.114193:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.114219:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.114239:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 19 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.114250:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104960b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788224:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126951.114312:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.121376:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.123851:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258904064 00000100:00100000:3.0:1789126951.123863:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258904064 00010000:00010000:3.0:1789126951.123943:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.125105:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:3.0:1789126951.125119:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:2394:x1876035258904064:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126951.125142:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126951.125152:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.125167:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.125189:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:3.0:1789126951.125194:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.125204:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.125212:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.125230:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126951.125295:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:2394:x1876035258904064:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 180us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.125303:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00010000:00010000:3.0:1789126951.128502:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb6f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c648 expref: 19 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.128526:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104960b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788224:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126951.128549:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.128581:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.128596:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126951.128976:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789126951.129145:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789126951.129176:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789126951.129240:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876035276788352:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789126951.129296:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126951.129333:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106840 going to sleep for 11 seconds 00000100:00100000:1.0:1789126951.130192:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276788352 00000100:00100000:1.0:1789126951.130203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276788352 00000100:00100000:1.0:1789126951.130269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789126951.130281:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1876035276788352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789126951.130401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1876035276788352:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126951.130541:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789126951.131107:0:6514:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789126951.131114:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104a53c00, transno 4294967316 00000100:00100000:3.0:1789126951.131175:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876035276788352:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789126951.131315:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789126951.131387:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876035276788480:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789126951.131443:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126951.131477:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef300 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.131541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276788480 00000100:00100000:0.0:1789126951.131547:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276788480 00000100:00100000:0.0:1789126951.131615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789126951.131623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1876035276788480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789126951.131916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1876035276788480:12345-0@lo:1000:mdt00_002.0 Request processed in 293us (472us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789126951.131923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789126951.132148:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104b42d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876035276788480:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789126951.132182:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132191:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132197:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132203:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.132208:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132225:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132240:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:3.0:1789126951.132242:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789126951.132247:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132252:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb73d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132273:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132280:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132286:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132291:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.132293:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132300:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132308:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126951.132311:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789126951.132313:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132329:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb672 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132369:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132377:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132404:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.132421:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 22 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.132435:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788608:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126951.132516:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef300 going to sleep for 11 seconds 00000100:00100000:3.0:1789126951.136477:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276788608:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126951.136509:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.136766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.137226:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258904192 00000100:00100000:3.0:1789126951.137233:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258904192 00010000:00010000:3.0:1789126951.137269:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 23 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.137328:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1789126951.137338:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:2394:x1876035258904192:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126951.137351:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126951.137358:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 23 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137370:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 23 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137391:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb68e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c62c expref: 23 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137403:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:3.0:1789126951.137408:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137417:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137424:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.137451:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126951.137481:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137489:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.137499:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941049630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:2394:x1876035258904192:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 162us (735us total) trans 0 rc 0/0 00010000:00010000:1.0:1789126951.137500:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.137506:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00010000:00010000:1.0:1789126951.137506:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137513:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137518:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126951.137523:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137530:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137538:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126951.137541:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126951.137545:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137551:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66400/0xa840b4da666eb744 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137561:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137567:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137579:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137584:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126951.137587:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137593:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137601:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9000) 00010000:00010000:1.0:1789126951.137604:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789126951.137607:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.137613:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb736 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.137768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12624:x1876035258903808:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 28866us (29424us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789126951.137778:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000020:00080000:1.0:1789126951.137782:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789126951.140149:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126951.140160:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126951.142132:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789126951.142147:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789126951.142988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.143098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258904448 00000100:00100000:3.0:1789126951.143107:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258904448 00000100:00100000:3.0:1789126951.143159:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1789126951.143170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212266c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12624:x1876035258904448:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789126951.143411:0:6515:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789126951.143443:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789126951.146243:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146266:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146278:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146288:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146294:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146301:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.146325:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789126951.146441:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212266c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:12624:x1876035258904448:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 3269us (3454us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789126951.146452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000020:00080000:2.0:1789126951.146458:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789126951.146618:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126951.146626:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.146635:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126951.146640:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.146678:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.146701:0:9514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:1.0:1789126951.146705:0:9514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789126951.146709:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.146715:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb74b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.146855:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126951.146857:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126951.146859:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789126951.219350:0:15393:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789126951.219363:0:15393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789126951.219398:0:15393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789126951.219406:0:15393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126951.329903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.330832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258904704 00000100:00100000:1.0:1789126951.330844:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258904704 00000100:00100000:1.0:1789126951.330916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:1.0:1789126951.330927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:12634:x1876035258904704:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126951.330950:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126951.330968:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c664 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.331066:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397000/0xa840b4da666eb759 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.331080:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397000/0xa840b4da666eb759 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.331092:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397000/0xa840b4da666eb759 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126951.331116:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789126951.331213:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c664 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.331231:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397000/0xa840b4da666eb759 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c664 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.331239:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126951.331242:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789126951.331246:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397000, rc 0) 00000100:00100000:1.0:1789126951.331308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12634:x1876035258904704:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 384us (1414us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789126951.331316:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:2.0:1789126951.337886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.337959:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258904832 00000100:00100000:0.0:1789126951.337968:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258904832 00000100:00100000:0.0:1789126951.338042:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1789126951.338053:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12634:x1876035258904832:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1789126951.338124:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338142:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338154:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338171:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338179:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338185:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338263:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338272:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338278:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126951.338333:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338346:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338352:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338365:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338371:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.338376:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338384:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338396:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126951.338399:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.338403:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338414:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338425:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338431:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338444:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338449:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.338452:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338458:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338467:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994102e04100) 00010000:00010000:0.0:1789126951.338469:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.338472:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338478:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb76e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338493:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338499:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338504:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338509:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.338512:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338527:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338535:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126951.338537:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.338539:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.338545:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.338613:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12634:x1876035258904832:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 561us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126951.338620:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00010000:00010000:1.0:1789126951.339932:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126951.399290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.399796:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905088 00000100:00100000:2.0:1789126951.399806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905088 00000100:00100000:2.0:1789126951.399866:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:2.0:1789126951.399888:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12637:x1876035258905088:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126951.399908:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126951.399929:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb77c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c66b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400009:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400034:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400049:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400063:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400170:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400207:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126951.400219:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789126951.400296:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400303:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400310:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400316:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.400321:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400328:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400340:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126951.400344:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126951.400348:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400354:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400365:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400370:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400383:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400388:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.400391:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400397:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400405:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994103ea9f00) 00010000:00010000:2.0:1789126951.400408:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126951.400410:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400416:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb78a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400455:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb77c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400469:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.400476:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126951.400478:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126951.400480:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2800, rc 0) 00000100:00100000:2.0:1789126951.400546:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12637:x1876035258905088:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 660us (1264us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789126951.400563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:0.0:1789126951.407429:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.407511:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905216 00000100:00100000:3.0:1789126951.407521:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905216 00000100:00100000:3.0:1789126951.407582:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:3.0:1789126951.407592:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12637:x1876035258905216:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126951.407681:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407697:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407710:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407757:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407763:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407769:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407789:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.407793:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407800:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407811:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.407814:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126951.407819:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.407824:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb79f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.407904:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12637:x1876035258905216:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 313us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.407912:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:3.0:1789126951.410558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.410641:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905472 00000100:00100000:1.0:1789126951.410686:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905472 00000100:00100000:1.0:1789126951.410743:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1789126951.410752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12637:x1876035258905472:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789126951.410977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:12637:x1876035258905472:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 225us (426us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789126951.410985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1789126951.438910:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.439000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905728 00000100:00100000:3.0:1789126951.439010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905728 00000100:00100000:3.0:1789126951.439070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:3.0:1789126951.439080:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:12170:x1876035258905728:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126951.439105:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126951.439126:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c672 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.439225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.439252:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.439261:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.439294:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.439305:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 29 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.439319:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276788736:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126951.439404:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213beff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.443509:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.443624:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276788736:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126951.443688:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.444217:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905856 00000100:00100000:1.0:1789126951.444225:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905856 00010000:00010000:1.0:1789126951.444261:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 30 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126951.444315:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:1.0:1789126951.444325:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:2393:x1876035258905856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126951.444339:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126951.444346:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 30 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444358:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 30 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444379:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb791 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c66b expref: 30 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444393:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:1.0:1789126951.444398:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444407:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444416:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.444444:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126951.444488:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:2393:x1876035258905856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 165us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126951.444497:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 106 00010000:00010000:3.0:1789126951.444560:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.444568:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126951.444587:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789126951.444735:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.444763:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.444771:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.444774:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789126951.444777:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66e00, rc 0) 00000100:00100000:3.0:1789126951.444801:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:12170:x1876035258905728:12345-192.168.203.23@tcp:101:bash.0 Request processed in 5723us (5900us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789126951.444807:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:0.0:1789126951.448911:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.448985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258905984 00000100:00100000:2.0:1789126951.449207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258905984 00000100:00100000:2.0:1789126951.449271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:2.0:1789126951.449281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:12170:x1876035258905984:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126951.449304:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126951.449324:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb7bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c679 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449356:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb7c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449382:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449491:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2000/0xa840b4da666eb7bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c679 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449508:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c679 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.449517:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126951.449520:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789126951.449524:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:2.0:1789126951.449625:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:12170:x1876035258905984:12345-192.168.203.23@tcp:101:bash.0 Request processed in 345us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.449639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:2.0:1789126951.453138:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.453247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258906240 00000100:00100000:1.0:1789126951.453267:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258906240 00000100:00100000:1.0:1789126951.453352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:1.0:1789126951.453362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:12170:x1876035258906240:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:1.0:1789126951.453566:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.453583:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.453594:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126951.453634:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1789126951.457122:0:6513:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001fbde7c2 reply state 00000000414f49dc transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.457147:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.457157:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:1.0:1789126951.457160:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789126951.457164:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789126951.457252:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1789126951.457382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:12170:x1876035258906240:12345-192.168.203.23@tcp:36:bash.0 Request processed in 4018us (4251us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789126951.457392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 208 00000020:00080000:1.0:1789126951.457399:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789126951.460025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.460102:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258906368 00000100:00100000:3.0:1789126951.460111:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258906368 00000100:00100000:3.0:1789126951.460158:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:3.0:1789126951.460167:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+34:12170:x1876035258906368:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126951.460189:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126951.460207:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c680 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.460256:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c680 expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.460271:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c680 expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.460287:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.460290:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789126951.460306:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67a00, rc 0) 00000100:00100000:3.0:1789126951.460363:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12170:x1876035258906368:12345-192.168.203.23@tcp:101:bash.0 Request processed in 196us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.460370:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:0.0:1789126951.462901:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.462945:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258906496 00000100:00100000:2.0:1789126951.462953:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258906496 00000100:00100000:2.0:1789126951.463007:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:2.0:1789126951.463017:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:12170:x1876035258906496:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126951.463031:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126951.463050:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c687 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126951.463072:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3e925, atime: 0x6aa3e924, ctime: 0x6aa3e925, blocks: 0x8 00010000:00010000:2.0:1789126951.463093:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789126951.463098:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126951.463106:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.463119:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.463130:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2000, rc 0) 00000100:00100000:2.0:1789126951.463181:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:12170:x1876035258906496:12345-192.168.203.23@tcp:101:bash.0 Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.463188:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:1.0:1789126951.470883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.471316:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258906624 00000100:00100000:2.0:1789126951.471324:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258906624 00002000:00010000:2.0:1789126951.471377:0:8434:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789126951.471382:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fc780 with x1876035258906624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789126951.471393:0:8434:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941043fc780. 00000100:00100000:2.0:1789126951.471429:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1789126951.471438:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2392:x1876035258906624:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:2.0:1789126951.472143:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789126951.472147:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789126949 -> 1789126951 00002000:00010000:2.0:1789126951.472149:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789126948 -> 1789126948 00002000:00010000:2.0:1789126951.472151:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789126949 -> 1789126951 00002000:00010000:2.0:1789126951.472152:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789126951.472328:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2392:x1876035258906624:12345-192.168.203.23@tcp:10:bash.0 Request processed in 888us (1462us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789126951.472335:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00002000:00010000:2.0:1789126951.472339:0:8434:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789126951.472346:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fc780 with x1876035258906624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789126951.472351:0:8434:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9941043fc780. 00000100:00100000:0.0:1789126951.534180:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.534267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258906752 00000100:00100000:3.0:1789126951.534276:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258906752 00000100:00100000:3.0:1789126951.534335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:3.0:1789126951.534345:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12651:x1876035258906752:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:3.0:1789126951.534413:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534429:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534440:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534454:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534461:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534467:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534540:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534572:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126951.534613:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534623:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534629:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534635:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534641:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.534691:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534700:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126951.534889:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.534896:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534903:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb7de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534917:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534930:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534936:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534941:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.534944:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534951:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534959:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:3.0:1789126951.534962:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.534965:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534971:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.534985:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535093:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535100:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535104:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.535113:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535120:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535129:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.535131:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.535133:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.535139:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.535256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12651:x1876035258906752:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 910us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.535264:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:0.0:1789126951.574965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.575132:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258907008 00000100:00100000:3.0:1789126951.575141:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258907008 00000100:00100000:3.0:1789126951.575202:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:3.0:1789126951.575213:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+35:12654:x1876035258907008:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126951.575233:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126951.575254:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c68e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575322:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575336:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575363:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575377:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575383:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575390:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575486:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575496:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575504:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126951.575514:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789126951.575584:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575593:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575600:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575606:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.575615:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575624:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575635:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126951.575638:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.575643:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575683:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb7fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575697:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575703:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575709:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575714:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.575717:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575722:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575729:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:3.0:1789126951.575731:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.575740:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575746:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575781:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb7f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c68e expref: 38 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575795:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c68e expref: 37 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.575803:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.575805:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789126951.575808:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66a00, rc 0) 00000100:00100000:3.0:1789126951.575857:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12654:x1876035258907008:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 646us (902us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789126951.575864:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:1.0:1789126951.579200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126951.579305:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258907136 00000100:00100000:2.0:1789126951.579314:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258907136 00000100:00100000:2.0:1789126951.579371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:2.0:1789126951.579382:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12654:x1876035258907136:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1789126951.579445:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.579460:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.579469:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.579514:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.579527:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 37 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.579542:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048cd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276788864:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126951.580109:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.583133:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.583216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258907392 00000100:00100000:3.0:1789126951.583234:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258907392 00000100:00100000:3.0:1789126951.583294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1789126951.583304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:6159:x1876035258907392:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789126951.583571:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:6159:x1876035258907392:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 268us (446us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789126951.583580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1789126951.584320:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048cd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276788864:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126951.584347:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.586728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.586804:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258907520 00000100:00100000:3.0:1789126951.586812:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258907520 00010000:00010000:3.0:1789126951.586853:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 39 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.586940:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:3.0:1789126951.586951:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:2394:x1876035258907520:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126951.586965:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126951.586972:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 39 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.586984:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 39 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.587022:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb7ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c672 expref: 39 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.587038:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.587043:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.587051:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.587059:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.587091:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126951.587143:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:2394:x1876035258907520:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 194us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.587152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 107 00010000:00010000:2.0:1789126951.587251:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587260:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587295:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587302:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587308:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587314:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.587318:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587333:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587342:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126951.587345:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789126951.587349:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.587355:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126951.587394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12654:x1876035258907136:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 8013us (8201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.587402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:0.0:1789126951.590462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.590539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258907776 00000100:00100000:3.0:1789126951.590563:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258907776 00000100:00100000:3.0:1789126951.590618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1789126951.590629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+37:12654:x1876035258907776:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126951.590877:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:12654:x1876035258907776:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 240us (415us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789126951.590886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1789126951.598966:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276788992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126951.599044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126951.599290:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276788992 00000100:00100000:2.0:1789126951.599298:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276788992 00000100:00100000:2.0:1789126951.599351:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789126951.599361:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276788992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789126951.599393:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789126951.599442:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276788992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.599449:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789126951.599577:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276788992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126951.657723:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.657802:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258908032 00000100:00100000:3.0:1789126951.657812:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258908032 00000100:00100000:2.0:1789126951.658461:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:2.0:1789126951.658472:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+38:12665:x1876035258908032:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1789126951.658497:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126951.658520:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb81d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c695 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658630:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658645:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658687:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658702:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658709:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658716:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658830:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb832 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658840:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658847:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126951.658857:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789126951.658934:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658942:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658955:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658962:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.658966:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658974:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.658986:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126951.658989:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126951.659006:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659013:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb824 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659026:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659032:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659037:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659042:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126951.659045:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659062:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659070:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994103ea9400) 00010000:00010000:2.0:1789126951.659072:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126951.659075:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659082:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb82b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659121:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb81d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c695 expref: 41 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659133:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb832 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c695 expref: 40 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.659141:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126951.659143:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126951.659158:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:2.0:1789126951.659223:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+40:12665:x1876035258908032:12345-192.168.203.23@tcp:101:cat.0 Request processed in 750us (1507us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789126951.659232:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1789126951.666625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.666800:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258908288 00000100:00100000:3.0:1789126951.666809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258908288 00000100:00100000:3.0:1789126951.666981:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1789126951.666992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+40:12665:x1876035258908288:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:3.0:1789126951.667264:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:12665:x1876035258908288:12345-192.168.203.23@tcp:35:cat.0 Request processed in 273us (647us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789126951.667272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1789126951.693132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.693814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258908544 00000100:00100000:3.0:1789126951.693824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258908544 00000100:00100000:3.0:1789126951.693910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:3.0:1789126951.693921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+41:12666:x1876035258908544:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:3.0:1789126951.693977:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789126951.694003:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb7d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c680 expref: 41 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694026:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eb832 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c695 expref: 40 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694055:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c68e expref: 39 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eb7c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c679 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694076:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.694082:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126951.694103:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694115:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694124:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694138:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694145:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694151:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694233:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694247:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789126951.694472:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1789126951.694521:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694553:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694561:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694567:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694573:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694594:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789126951.694612:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694619:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694625:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694641:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.694667:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694677:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694686:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:3.0:1789126951.694689:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789126951.694693:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694698:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb84e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694714:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694721:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694726:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694730:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126951.694733:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694738:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694755:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126951.694758:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126951.694761:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694767:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66e00/0xa840b4da666eb840 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789126951.694777:0:6512:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c2d41514 reply state 000000004d59a27b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.694794:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:3.0:1789126951.694796:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789126951.694798:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789126951.694882:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12666:x1876035258908544:12345-192.168.203.23@tcp:36:rm.0 Request processed in 963us (1759us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789126951.694889:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00010000:00010000:0.0:1789126951.697426:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126951.697438:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.697448:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789126951.697452:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.697461:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.697476:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:0.0:1789126951.697479:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789126951.697483:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.697489:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67400/0xa840b4da666eb855 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.697505:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126951.697507:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126951.697508:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126951.744757:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.744900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258908800 00000100:00100000:1.0:1789126951.744910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258908800 00000100:00100000:1.0:1789126951.744985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:1.0:1789126951.745008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+39:12672:x1876035258908800:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1789126951.745032:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126951.745053:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb85c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c69c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745163:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745177:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745189:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745200:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745206:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745212:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789126951.745509:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789126951.745635:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.745644:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126951.746273:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746408:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746416:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746422:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746440:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126951.746445:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746452:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746463:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126951.746467:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126951.746472:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746478:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb863 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789126951.746495:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000094c467bf reply state 0000000083914eab transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746505:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746511:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:0.0:1789126951.746513:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789126951.746516:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789126951.746551:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb85c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746566:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.746583:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:0.0:1789126951.746586:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126951.746588:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396200, rc 0) 00000100:00100000:0.0:1789126951.746733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12672:x1876035258908800:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1727us (1983us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789126951.746742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:0.0:1789126951.750175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.750256:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258908928 00000100:00100000:3.0:1789126951.750266:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258908928 00000100:00100000:3.0:1789126951.750341:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1789126951.750351:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258908928:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126951.750367:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126951.750386:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6a3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126951.750409:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:0.0:1789126951.750435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789126951.750447:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1789126951.750452:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.750462:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.750479:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.750493:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66e00, rc 0) 00000100:00100000:3.0:1789126951.750557:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258908928:12345-192.168.203.23@tcp:101:bash.0 Request processed in 207us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.750565:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:1.0:1789126951.757207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126951.757833:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909056 00000100:00100000:0.0:1789126951.757844:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909056 00000100:00100000:0.0:1789126951.757967:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1789126951.757977:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:12672:x1876035258909056:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789126951.758004:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126951.758023:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6aa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.758058:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.758067:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.758071:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126951.758077:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.758111:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126951.758141:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 9 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126951.758157:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276789120:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126951.758265:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789126951.761050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.761452:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909184 00000100:00100000:3.0:1789126951.761462:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909184 00010000:00010000:3.0:1789126951.761502:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 10 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.761596:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:3.0:1789126951.761607:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2394:x1876035258909184:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126951.761621:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126951.761643:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 10 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.761692:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 10 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.761733:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.761737:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126951.761746:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.761756:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.761794:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.761807:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666eb87f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6a3 expref: 10 pid: 8429 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126951.761809:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876035276789248:192.168.203.23@tcp:105: 00000100:00100000:2.0:1789126951.761831:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876035276789120:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126951.761887:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126951.761899:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166200, rc 0) 00000100:00100000:3.0:1789126951.761914:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213befe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789126951.761934:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:12672:x1876035258909056:12345-192.168.203.23@tcp:101:bash.0 Request processed in 3959us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126951.761942:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1789126951.763833:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876035276789248:192.168.203.23@tcp:105: 00010000:00010000:3.0:1789126951.763877:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126951.763930:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258909184:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 2324us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.763941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:0.0:1789126951.770092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126951.770186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909440 00000100:00100000:1.0:1789126951.770195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909440 00000100:00100000:1.0:1789126951.770254:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1789126951.770265:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+42:12672:x1876035258909440:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1789126951.770553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:12672:x1876035258909440:12345-192.168.203.23@tcp:35:bash.0 Request processed in 289us (470us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789126951.770561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:0.0:1789126951.993190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126951.993277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909568 00000100:00100000:3.0:1789126951.993286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909568 00000100:00100000:3.0:1789126951.993336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:3.0:1789126951.993345:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+43:12688:x1876035258909568:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126951.993368:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126951.993388:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb88d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993493:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993510:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993525:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126951.993572:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789126951.993576:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126951.993596:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993620:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb88d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b1 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993637:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b1 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126951.993645:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126951.993698:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789126951.993702:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66a00, rc 0) 00000100:00100000:3.0:1789126951.993767:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+44:12688:x1876035258909568:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 421us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126951.993774:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:0.0:1789126952.008193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.008494:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909824 00000100:00100000:2.0:1789126952.008503:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909824 00000100:00100000:2.0:1789126952.008698:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:2.0:1789126952.008711:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+44:12688:x1876035258909824:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126952.008732:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126952.008751:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb89b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6b8 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.008881:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb8a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.008894:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.008905:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126952.008915:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789126952.009010:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb89b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b8 expref: 47 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.009028:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b8 expref: 46 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.009050:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:2.0:1789126952.009053:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126952.009056:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:2.0:1789126952.009129:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:12688:x1876035258909824:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 420us (945us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789126952.009136:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:1.0:1789126952.014424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126952.014632:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258909952 00000100:00100000:0.0:1789126952.014642:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258909952 00000100:00100000:0.0:1789126952.014726:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789126952.014736:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+46:2391:x1876035258909952:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126952.014752:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126952.014777:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb8a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b8 expref: 46 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.015032:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:0.0:1789126952.015039:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126952.015112:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:2391:x1876035258909952:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 378us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126952.015120:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789126952.019601:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.019916:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910208 00000100:00100000:3.0:1789126952.019926:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910208 00000100:00100000:3.0:1789126952.020046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:3.0:1789126952.020057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+45:12688:x1876035258910208:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126952.020191:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126952.020277:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb8b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.020431:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.020446:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.020457:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126952.020468:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789126952.020567:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb8b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6bf expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.020585:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6bf expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.020593:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:3.0:1789126952.020596:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789126952.020599:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67a00, rc 0) 00000100:00100000:3.0:1789126952.022014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:12688:x1876035258910208:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1952us (2414us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789126952.022025:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:1.0:1789126952.044117:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.044574:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910336 00000100:00100000:3.0:1789126952.044599:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910336 00000100:00100000:3.0:1789126952.044691:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1789126952.044702:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2392:x1876035258910336:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:3.0:1789126952.044742:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.044762:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.044771:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789126952.044776:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126952.044795:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.044837:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.044852:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 8 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.044875:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276789376:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126952.044968:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126952.047497:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876035276789376:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126952.047527:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.049143:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.049267:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910464 00000100:00100000:3.0:1789126952.049274:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910464 00002000:00100000:3.0:1789126952.049331:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9941043fed00 x1876035258910464/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:443/0 lens 504/0 e 0 to 0 dl 1789126963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126952.049342:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fed00 with x1876035258910464 ext(0->8) 00010000:00010000:3.0:1789126952.049352:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 9 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.049367:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 9 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126952.049375:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9941043fed00 00000100:00100000:3.0:1789126952.049408:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1789126952.049418:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2391:x1876035258910464:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:3.0:1789126952.051129:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2391:x1876035258910464:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 1706us (1986us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789126952.051142:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:3.0:1789126952.051150:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9941043fed00 x1876035258910464/t4294967309(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:443/0 lens 504/448 e 0 to 0 dl 1789126963 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126952.051159:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9941043fed00 with x1876035258910464 ext(0->8) 00010000:00010000:3.0:1789126952.051168:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.051200:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789126952.051218:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9941043fed00 00000100:00100000:1.0:1789126952.062986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.063401:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910592 00000100:00100000:3.0:1789126952.063411:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910592 00010000:00010000:3.0:1789126952.063457:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.063502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1789126952.063513:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2394:x1876035258910592:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126952.063528:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789126952.063545:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789126952.063548:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789126951 00002000:00010000:3.0:1789126952.063550:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789126951 00002000:00010000:3.0:1789126952.063552:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789126951 00002000:00010000:3.0:1789126952.063554:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789126952.063562:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.063575:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.063601:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666eb886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6aa expref: 11 pid: 8430 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.063640:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126952.063644:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126952.063705:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.063716:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.063754:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789126952.063801:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.063807:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2394:x1876035258910592:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 295us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.063822:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00010000:00010000:2.0:1789126952.063826:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063848:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063856:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063874:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063882:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126952.063885:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063906:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063917:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.063924:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b33339/0xa840b4da666eb8c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126952.063980:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2392:x1876035258910336:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 19269us (19860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126952.064001:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1789126952.067410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126952.067514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910848 00000100:00100000:1.0:1789126952.067525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910848 00000100:00100000:1.0:1789126952.067580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:1.0:1789126952.067590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212264450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+47:12688:x1876035258910848:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:1.0:1789126952.067685:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6bf expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789126952.067874:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789126952.067914:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789126952.068337:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789126952.068375:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.068390:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.068409:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.068444:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.068457:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 51 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.068471:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276789504:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126952.068545:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106300 going to sleep for 11 seconds 00000100:00100000:1.0:1789126952.076730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.076808:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258910976 00000100:00100000:3.0:1789126952.076816:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258910976 00010000:00010000:3.0:1789126952.076854:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 52 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.076904:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:3.0:1789126952.076914:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:2393:x1876035258910976:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126952.076928:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126952.076935:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 52 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.076948:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 52 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.077002:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:3.0:1789126952.077008:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.077018:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.077025:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.077043:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126952.077097:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+52:2393:x1876035258910976:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 184us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.077104:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00010000:00010000:0.0:1789126952.077304:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eb871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c69c expref: 51 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126952.077322:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043ff0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876035276789504:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126952.077343:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.077352:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.077358:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126952.077465:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789126952.077588:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789126952.077930:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276789632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789126952.077992:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126952.078023:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520780 going to sleep for 11 seconds 00000100:00100000:1.0:1789126952.078133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276789632 00000100:00100000:1.0:1789126952.078140:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276789632 00000100:00100000:1.0:1789126952.078187:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789126952.078196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276789632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126952.078311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276789632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.078319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789126952.078390:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276789632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789126952.078495:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1789126952.078538:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276789760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789126952.078571:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126952.078589:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789126952.078671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276789760 00000100:00100000:1.0:1789126952.078675:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276789760 00000100:00100000:1.0:1789126952.078698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789126952.078704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1876035276789760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789126952.078791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6516:x1876035276789760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (218us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789126952.078808:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789126952.078976:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876035276789760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789126952.079024:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789126952.079051:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079070:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079076:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079082:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126952.079086:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079094:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079108:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:0.0:1789126952.079111:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789126952.079116:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.079123:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666eb8cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789126952.079211:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789126952.079271:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789126952.079282:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377283633048ns, next at 378283630966ns, rc = 0 00000001:00080000:0.0:1789126952.079289:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789126952.079309:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99420b04ad00) 00010000:00010000:0.0:1789126952.079312:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789126952.079319:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb8b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6bf expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126952.079423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212264450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:12688:x1876035258910848:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 11834us (12023us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789126952.079431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000020:00080000:0.0:1789126952.079435:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789126952.084547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126952.084643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258911104 00000100:00100000:0.0:1789126952.084667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258911104 00000100:00100000:0.0:1789126952.084764:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:0.0:1789126952.084775:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+54:12688:x1876035258911104:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126952.084800:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126952.084823:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb8d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.084891:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6c6 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.084906:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6c6 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.084925:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126952.084929:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789126952.084932:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166e00, rc 0) 00000100:00100000:0.0:1789126952.084993:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:12688:x1876035258911104:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126952.085000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:1.0:1789126952.091430:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.091536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258911360 00000100:00100000:3.0:1789126952.091545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258911360 00000100:00100000:3.0:1789126952.091607:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1789126952.091618:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+55:12688:x1876035258911360:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789126952.091884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12688:x1876035258911360:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 267us (462us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789126952.091892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1789126952.107002:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104a52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276789888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126952.107074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126952.107257:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276789888 00000100:00100000:1.0:1789126952.107265:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276789888 00000100:00100000:1.0:1789126952.107334:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789126952.107344:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276789888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126952.107369:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126952.107414:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276789888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.107421:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789126952.107487:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126952.107523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104a52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276789888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126952.107662:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126952.107670:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276790016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126952.107698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126952.107837:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276790016 00000100:00100000:3.0:1789126952.107842:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276790016 00000100:00100000:3.0:1789126952.107883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789126952.107891:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1876035276790016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789126952.107902:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789126952.107944:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1876035276790016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.107965:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789126952.108241:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276790016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126952.203089:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.203457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258911488 00000100:00100000:2.0:1789126952.203467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258911488 00000100:00100000:2.0:1789126952.203564:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:2.0:1789126952.203575:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12698:x1876035258911488:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1789126952.203687:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203704:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203726:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203738:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203745:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203751:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203819:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203828:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203835:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789126952.203892:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203906:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203923:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203929:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203935:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126952.203940:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203947:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203959:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126952.203962:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126952.203967:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.203974:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204404:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204412:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204417:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204422:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126952.204431:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204439:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204448:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:2.0:1789126952.204451:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126952.204454:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204460:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204471:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204477:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204483:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204487:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126952.204490:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204496:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204503:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:2.0:1789126952.204505:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126952.204515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.204520:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126952.204598:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12698:x1876035258911488:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1024us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126952.204607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:1.0:1789126952.246748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.247220:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258911744 00000100:00100000:2.0:1789126952.247229:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258911744 00000100:00100000:2.0:1789126952.247290:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:2.0:1789126952.247300:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+56:12701:x1876035258911744:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789126952.247320:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126952.247340:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6cd expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247410:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247424:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247435:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247445:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247453:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247478:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247576:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247584:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247592:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126952.247601:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789126952.247719:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247727:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247733:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247739:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126952.247743:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247751:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247763:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:2.0:1789126952.247766:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126952.247778:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247784:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb8f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247798:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247804:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247809:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247814:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126952.247817:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247823:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247830:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:2.0:1789126952.247832:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126952.247835:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247840:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666eb8fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247888:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2200/0xa840b4da666eb8ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247913:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 58 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.247919:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:2.0:1789126952.247921:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789126952.247924:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2800, rc 0) 00000100:00100000:2.0:1789126952.247982:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12701:x1876035258911744:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 684us (1244us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789126952.248264:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:1.0:1789126952.252099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.252281:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258911872 00000100:00100000:3.0:1789126952.252291:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258911872 00000100:00100000:3.0:1789126952.252353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:3.0:1789126952.252363:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12701:x1876035258911872:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126952.252429:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252446:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252459:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252492:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252499:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252505:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252511:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126952.252515:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252522:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252548:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126952.252550:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126952.252556:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.252562:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb912 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.252636:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12701:x1876035258911872:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 273us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.252643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:3.0:1789126952.256321:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.256478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258912128 00000100:00100000:2.0:1789126952.256488:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258912128 00000100:00100000:2.0:1789126952.256553:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:2.0:1789126952.256564:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+58:12701:x1876035258912128:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1789126952.256813:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12701:x1876035258912128:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 250us (502us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789126952.256821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1789126952.334552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.334645:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258912384 00000100:00100000:2.0:1789126952.334743:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258912384 00000100:00100000:0.0:1789126952.334992:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:0.0:1789126952.335309:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12711:x1876035258912384:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789126952.335351:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126952.335355:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789126952.335381:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb894 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6b1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335400:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:0.0:1789126952.335406:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789126952.335420:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb919 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6d4 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335544:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335560:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335569:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335602:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.335618:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 59 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126952.335632:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276790144:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126952.335856:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520900 going to sleep for 11 seconds 00000100:00100000:0.0:1789126952.339296:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276790144:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126952.339343:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.343063:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126952.343178:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258912512 00000100:00100000:0.0:1789126952.343188:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258912512 00010000:00010000:0.0:1789126952.343228:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 60 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126952.343324:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:0.0:1789126952.343335:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:2393:x1876035258912512:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126952.343349:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126952.343358:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 60 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343371:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 60 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343394:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6cd expref: 60 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343409:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126952.343414:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343422:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343429:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.343481:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126952.343540:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:2393:x1876035258912512:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 206us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126952.343557:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00010000:00010000:1.0:1789126952.343615:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.343623:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126952.343641:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789126952.343797:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167200/0xa840b4da666eb919 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 60 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.343824:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.343845:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126952.343849:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789126952.343851:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167000, rc 0) 00000100:00100000:1.0:1789126952.343890:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104a52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12711:x1876035258912384:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8586us (9347us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789126952.343897:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:1.0:1789126952.350421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.350734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258912640 00000100:00100000:3.0:1789126952.350743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258912640 00000100:00100000:3.0:1789126952.350806:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:3.0:1789126952.350816:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+59:12711:x1876035258912640:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789126952.350841:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126952.350861:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb92e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.350904:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.350918:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.350929:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.351046:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb92e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.351063:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.351071:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126952.351074:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789126952.351078:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66800, rc 0) 00000100:00100000:3.0:1789126952.352257:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:12711:x1876035258912640:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1435us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.352267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:2.0:1789126952.356211:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126952.356964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258912896 00000100:00100000:0.0:1789126952.356975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258912896 00000100:00100000:0.0:1789126952.357047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:0.0:1789126952.357058:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+60:12711:x1876035258912896:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1789126952.357272:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.357289:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.357301:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789126952.357343:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789126952.357366:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009a7c834e reply state 00000000641dff78 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.357379:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.357387:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126952.357390:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789126952.357393:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789126952.357487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12711:x1876035258912896:12345-192.168.203.23@tcp:36:bash.0 Request processed in 431us (1285us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789126952.357512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 225 00000020:00080000:0.0:1789126952.357517:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789126952.360914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.361354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913024 00000100:00100000:2.0:1789126952.361363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913024 00000100:00100000:2.0:1789126952.361476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:2.0:1789126952.361487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12711:x1876035258913024:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789126952.361575:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126952.361595:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.361880:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.361895:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.361904:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.361951:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.361967:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 64 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126952.362124:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276790272:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126952.362252:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789126952.363125:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126952.364986:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876035276790272:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126952.365024:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.367546:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.368222:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913152 00000100:00100000:3.0:1789126952.368232:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913152 00010000:00010000:3.0:1789126952.368274:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 65 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126952.368319:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:3.0:1789126952.368330:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:2394:x1876035258913152:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126952.368346:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126952.368352:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 65 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368366:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 65 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368411:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb920 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6d4 expref: 65 pid: 9524 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368428:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126952.368433:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368441:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368448:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.368573:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126952.368630:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:2394:x1876035258913152:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 302us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.368639:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00010000:00010000:1.0:1789126952.369509:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.369521:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126952.369574:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789126952.369578:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126952.369597:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.369628:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666eb943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.369644:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.370269:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126952.370272:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126952.370275:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2600, rc 0) 00000100:00100000:1.0:1789126952.370377:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12711:x1876035258913024:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8891us (9472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.370386:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:1.0:1789126952.376163:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.376349:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913408 00000100:00100000:2.0:1789126952.376366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913408 00000100:00100000:2.0:1789126952.376475:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1789126952.376487:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+63:12711:x1876035258913408:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1789126952.376740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12711:x1876035258913408:12345-192.168.203.23@tcp:35:bash.0 Request processed in 255us (585us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789126952.376749:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1789126952.428478:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126952.428637:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913536 00000100:00100000:1.0:1789126952.428669:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913536 00000100:00100000:1.0:1789126952.428775:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:1.0:1789126952.428786:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+64:12717:x1876035258913536:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126952.428808:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126952.428828:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6e9 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.428902:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.428915:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.428925:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126952.428965:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789126952.428969:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126952.429003:0:9524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.429043:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396800/0xa840b4da666eb951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e9 expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.429062:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e9 expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.429070:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126952.429073:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789126952.429077:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397600, rc 0) 00000100:00100000:1.0:1789126952.429247:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258913536:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 462us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.429254:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:1.0:1789126952.438011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.438887:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913664 00000100:00100000:3.0:1789126952.438899:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913664 00000100:00100000:3.0:1789126952.438962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 228 00000100:00100000:3.0:1789126952.438972:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258913664:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789126952.439002:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126952.439024:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb95f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439089:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439120:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439131:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439144:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439151:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439157:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439229:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439238:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439246:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789126952.439286:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789126952.439290:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789126952.439308:0:6512:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439321:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439341:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439346:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439353:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439359:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126952.439363:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439371:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439383:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:3.0:1789126952.439386:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126952.439391:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439398:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666eb966 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439411:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439417:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439422:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439432:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126952.439435:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439441:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439449:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:3.0:1789126952.439451:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789126952.439454:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439459:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb96d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439483:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb95f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f0 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439494:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f0 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.439500:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126952.439503:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789126952.439505:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67e00, rc 0) 00000100:00100000:3.0:1789126952.439574:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12717:x1876035258913664:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 604us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.439582:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 228 00000100:00100000:2.0:1789126952.443247:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126952.443325:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258913792 00000100:00100000:1.0:1789126952.443335:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258913792 00000100:00100000:1.0:1789126952.443398:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789126952.443409:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:2393:x1876035258913792:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126952.443424:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126952.443450:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67e00/0xa840b4da666eb974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f0 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.443468:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126952.443473:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126952.443529:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:2393:x1876035258913792:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 123us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.443537:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1789126952.444283:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126952.444423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914048 00000100:00100000:0.0:1789126952.444428:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914048 00000100:00100000:0.0:1789126952.444710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:0.0:1789126952.444721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258914048:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126952.444738:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126952.444756:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb97b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.444878:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.444893:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.444902:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.444933:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.444947:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 66 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126952.444960:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276790400:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126952.445044:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520900 going to sleep for 11 seconds 00000100:00100000:0.0:1789126952.448519:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276790400:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126952.448542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:0.0:1789126952.448545:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.448632:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914176 00000100:00100000:1.0:1789126952.448639:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914176 00010000:00010000:1.0:1789126952.448830:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 67 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126952.448915:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:1.0:1789126952.448924:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:2394:x1876035258914176:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126952.448939:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126952.448945:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 67 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.448957:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 67 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.448983:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666eb94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e2 expref: 67 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.449006:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126952.449011:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.449020:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.449027:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.449055:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126952.449108:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:2394:x1876035258914176:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 185us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.449126:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00010000:00010000:0.0:1789126952.449172:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.449179:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126952.449196:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789126952.449320:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb97b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.449336:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126952.449344:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126952.449347:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789126952.449349:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167800, rc 0) 00000100:00100000:0.0:1789126952.449616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12717:x1876035258914048:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 4897us (5334us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789126952.449623:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:2.0:1789126952.452927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126952.453024:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914432 00000100:00100000:3.0:1789126952.453045:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914432 00000100:00100000:3.0:1789126952.453139:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1789126952.453149:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12717:x1876035258914432:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1789126952.453163:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126952.453186:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb8d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6c6 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126952.453210:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126952.453215:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126952.453300:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258914432:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 153us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126952.453308:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1789126952.455426:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126952.455512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914560 00000100:00100000:2.0:1789126952.455521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914560 00000100:00100000:2.0:1789126952.455586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:2.0:1789126952.455596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258914560:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:2.0:1789126952.455740:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.455767:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126952.455781:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789126952.456060:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789126952.456146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258914560:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 551us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126952.456155:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:2.0:1789126952.463744:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126952.463850:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914688 00000100:00100000:1.0:1789126952.463869:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914688 00000100:00100000:1.0:1789126952.463963:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:1.0:1789126952.463974:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+65:12717:x1876035258914688:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126952.463997:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126952.464019:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c6fe expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464074:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464085:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464103:0:9524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464115:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464128:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126952.464131:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126952.464135:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126952.464143:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397800, rc 0) 00000100:00100000:1.0:1789126952.464216:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12717:x1876035258914688:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 244us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126952.464223:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:1.0:1789126953.131377:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276790528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789126953.131451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126953.131602:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276790528 00000100:00100000:3.0:1789126953.131610:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276790528 00000100:00100000:3.0:1789126953.131694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789126953.131704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276790528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789126953.131735:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789126953.132148:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276790528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 445us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.132157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789126953.132225:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276790528:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789126953.195124:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789126953.195133:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789126953.195158:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:2.0:1789126953.195166:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789126953.195291:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276790656:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789126953.195406:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789126953.201273:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276790656:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789126953.201572:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.202312:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914816 00000100:00100000:1.0:1789126953.202320:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914816 00000100:00100000:1.0:1789126953.202433:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:1.0:1789126953.202444:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12718:x1876035258914816:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126953.202475:0:6513:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126953.202593:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12718:x1876035258914816:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 151us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.202601:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00080000:2.0:1789126953.203321:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126953.210291:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.210492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258914944 00000100:00100000:0.0:1789126953.210503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258914944 00000100:00100000:0.0:1789126953.210881:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:0.0:1789126953.210894:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12718:x1876035258914944:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789126953.210967:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211004:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211018:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211035:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211042:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211049:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211071:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211081:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211088:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126953.211133:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789126953.211138:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789126953.211149:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211160:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211176:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211182:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211188:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.211192:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211200:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211211:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:0.0:1789126953.211214:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126953.211220:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211226:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666eb99e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211239:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211245:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211251:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211256:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.211264:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211271:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211279:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff994102e04100) 00010000:00010000:0.0:1789126953.211281:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126953.211284:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211290:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666eb9a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211304:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211310:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211315:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211320:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.211322:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211328:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211334:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126953.211336:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126953.211345:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.211351:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666eb9ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.211426:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12718:x1876035258914944:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 534us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126953.211434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:0.0:1789126953.217771:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.217976:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258915200 00000100:00100000:1.0:1789126953.217986:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258915200 00000100:00100000:1.0:1789126953.218052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:1.0:1789126953.218062:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+66:12718:x1876035258915200:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.218083:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126953.218101:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb9b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c705 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218205:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218219:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218243:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126953.218256:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789126953.218329:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218336:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218342:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218348:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126953.218352:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218358:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218370:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126953.218373:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789126953.218377:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218383:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218421:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb9b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c705 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218442:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:1.0:1789126953.218445:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789126953.218449:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb9b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c705 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.218457:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397a00, rc 0) 00000100:00100000:1.0:1789126953.218513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915200:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 451us (753us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789126953.218520:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:3.0:1789126953.227338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.227812:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258915328 00000100:00100000:1.0:1789126953.227822:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258915328 00000100:00100000:1.0:1789126953.227885:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:1.0:1789126953.227894:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915328:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789126953.228035:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789126953.228179:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915328:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 286us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.228186:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:2.0:1789126953.232923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.233540:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258915584 00000100:00100000:1.0:1789126953.233550:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258915584 00000100:00100000:1.0:1789126953.233684:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1789126953.233695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.233723:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126953.233726:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789126953.233757:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eb958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6e9 expref: 67 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.233795:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126953.233801:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126953.233825:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb9c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c70c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789126953.234366:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789126953.234498:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.234511:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.234520:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.234569:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eb9c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c70c expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.234584:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c70c expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.234591:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99420b04a300) 00010000:00010000:1.0:1789126953.234594:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126953.234596:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397e00, rc 0) 00000100:00100000:1.0:1789126953.234709:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12718:x1876035258915584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1795us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789126953.234721:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:0.0:1789126953.240111:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.240280:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258915840 00000100:00100000:1.0:1789126953.240290:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258915840 00000100:00100000:1.0:1789126953.240791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:1.0:1789126953.240803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12718:x1876035258915840:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.240868:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126953.240895:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eb9cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c70c expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.240914:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99420b04a300) 00010000:00010000:1.0:1789126953.240924:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126953.240946:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.240959:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.240968:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.240982:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.240989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241004:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241227:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241251:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241258:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241264:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126953.241268:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241275:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241284:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126953.241287:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126953.241291:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.241296:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eb9dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243880:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243903:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243911:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243917:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126953.243942:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243952:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.243966:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xcaaad969 (ffff99420b04ab00) 00010000:00010000:1.0:1789126953.243969:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126953.243973:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.244570:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcaaad969 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.244974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915840:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 4169us (4868us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789126953.244984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:2.0:1789126953.249469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.249580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258915968 00000100:00100000:3.0:1789126953.249589:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258915968 00000100:00100000:3.0:1789126953.249851:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:3.0:1789126953.249885:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+67:12718:x1876035258915968:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789126953.249905:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789126953.249925:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb9eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c713 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250160:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250173:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250182:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250362:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67a00/0xa840b4da666eb9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250819:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.250828:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126953.250831:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789126953.250834:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67c00, rc 0) 00000100:00100000:3.0:1789126953.250961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12718:x1876035258915968:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1077us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.250969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:2.0:1789126953.255853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.256055:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258916224 00000100:00100000:1.0:1789126953.256065:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258916224 00000100:00100000:1.0:1789126953.256126:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:1.0:1789126953.256137:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+68:12718:x1876035258916224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.256229:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.256246:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.256258:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789126953.256704:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789126953.256730:0:9524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378461080476ns, next at 379461078301ns, rc = 0 00000004:00010000:1.0:1789126953.256780:0:9524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007b64af96 reply state 000000007d5d4899 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.256793:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.256801:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126953.256804:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789126953.256807:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126953.258342:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12718:x1876035258916224:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2199us (2492us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789126953.258353:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:0.0:1789126953.260871:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.260956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258916352 00000100:00100000:1.0:1789126953.260965:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258916352 00000100:00100000:1.0:1789126953.261027:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:1.0:1789126953.261037:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+70:12718:x1876035258916352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.261059:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126953.261080:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c71a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.261134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.261148:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.261167:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126953.261171:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126953.261184:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396e00, rc 0) 00000100:00100000:1.0:1789126953.261252:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+71:12718:x1876035258916352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 216us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.261260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:2.0:1789126953.264292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.264440:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258916480 00000100:00100000:3.0:1789126953.264450:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258916480 00000100:00100000:3.0:1789126953.264526:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1789126953.264551:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2393:x1876035258916480:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789126953.264834:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126953.264956:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2393:x1876035258916480:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 406us (672us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789126953.264964:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:2.0:1789126953.271699:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.271788:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258916736 00000100:00100000:0.0:1789126953.271798:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258916736 00000100:00100000:0.0:1789126953.271854:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1789126953.271874:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+71:12718:x1876035258916736:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789126953.272103:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+72:12718:x1876035258916736:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 232us (413us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789126953.272111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1789126953.274838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.274938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258916992 00000100:00100000:2.0:1789126953.274947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258916992 00000100:00100000:2.0:1789126953.275020:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:2.0:1789126953.275030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+72:12718:x1876035258916992:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789126953.275139:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+72:12718:x1876035258916992:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126953.275146:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:3.0:1789126953.277730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.277818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917120 00000100:00100000:1.0:1789126953.277825:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917120 00000100:00100000:1.0:1789126953.277880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00100000:1.0:1789126953.277889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+72:12718:x1876035258917120:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.277907:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126953.277925:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eba07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c721 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278009:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278024:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278036:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126953.278080:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126953.278099:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278125:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397e00/0xa840b4da666eba07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c721 expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278143:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c721 expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.278170:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126953.278173:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789126953.278176:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397a00, rc 0) 00000100:00100000:1.0:1789126953.278357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+73:12718:x1876035258917120:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 467us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.278364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 242 00000100:00100000:3.0:1789126953.281533:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.281622:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917248 00000100:00100000:2.0:1789126953.281631:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917248 00000100:00100000:2.0:1789126953.281732:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:2.0:1789126953.281742:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+10:2394:x1876035258917248:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789126953.281763:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126953.281781:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c728 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789126953.281805:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3e928, blocks: 0x0 00010000:00010000:2.0:1789126953.281823:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789126953.281827:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789126953.281836:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.282202:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.282216:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:2.0:1789126953.282279:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2394:x1876035258917248:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 539us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126953.282287:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1789126953.285293:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.285387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917504 00000100:00100000:2.0:1789126953.285397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917504 00000100:00100000:2.0:1789126953.285455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 243 00000100:00100000:2.0:1789126953.285465:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+73:12718:x1876035258917504:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789126953.285689:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+73:12718:x1876035258917504:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 225us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126953.285697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 243 00000100:00100000:2.0:1789126953.288840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.288937:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917632 00000100:00100000:0.0:1789126953.288946:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917632 00000100:00100000:0.0:1789126953.289044:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1789126953.289054:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:12718:x1876035258917632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126953.289069:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126953.289087:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c72f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.289136:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.289145:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126953.289149:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789126953.289154:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.289188:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.289327:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.289342:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276790784:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126953.289480:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789126953.294631:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.294713:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.294739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.294759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.294774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.294790:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.294951:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876035276790784:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126953.294991:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.295141:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167400, rc 0) 00000100:00100000:0.0:1789126953.295282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:12718:x1876035258917632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 6229us (6450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126953.295292:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:0.0:1789126953.295343:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918144 00000100:00100000:0.0:1789126953.295350:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918144 00000100:00100000:0.0:1789126953.295401:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:0.0:1789126953.295410:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2392:x1876035258918144:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126953.295448:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2392:x1876035258918144:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 40us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126953.295454:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00080000:0.0:1789126953.295471:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126953.295623:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917888 00000100:00100000:1.0:1789126953.295628:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917888 00000100:00100000:1.0:1789126953.295690:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 446 00000100:00100000:1.0:1789126953.295698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258917888:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126953.295736:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2392:x1876035258917888:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 39us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.295744:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 446 00000100:00100000:1.0:1789126953.295774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918400 00000100:00100000:1.0:1789126953.295778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918400 00000100:00080000:1.0:1789126953.295794:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126953.295815:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918016 00000100:00100000:1.0:1789126953.295818:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918016 00000100:00080000:1.0:1789126953.295828:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126953.295839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918272 00000100:00100000:1.0:1789126953.295842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918272 00000100:00080000:1.0:1789126953.295851:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126953.295878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 319 00000100:00100000:1.0:1789126953.295885:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258918400:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126953.295914:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258918400:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.295934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 319 00000100:00100000:1.0:1789126953.295947:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 320 00000100:00100000:1.0:1789126953.295953:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258918016:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126953.295976:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2392:x1876035258918016:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.296000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 320 00000100:00100000:1.0:1789126953.296013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 321 00000100:00100000:1.0:1789126953.296020:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258918272:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126953.296043:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2392:x1876035258918272:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.296049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 321 00000100:00100000:3.0:1789126953.296406:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258917760 00000100:00100000:3.0:1789126953.296411:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258917760 00010000:00010000:3.0:1789126953.296441:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.296481:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1789126953.296488:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+12:2394:x1876035258917760:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126953.296498:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126953.296519:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.296532:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.296554:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059011ba9/0xa840b4da666eba15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c728 expref: 12 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.296569:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126953.296574:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126953.296592:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.296602:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.296637:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.296674:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876035276790912:192.168.203.23@tcp:105: 00000100:00100000:3.0:1789126953.296795:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef600 going to sleep for 11 seconds 00000100:00100000:3.0:1789126953.300700:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876035276790912:192.168.203.23@tcp:105: 00010000:00010000:3.0:1789126953.300728:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126953.300787:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2394:x1876035258917760:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 4298us (6164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.300799:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:2.0:1789126953.307011:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.307097:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918528 00000100:00100000:3.0:1789126953.307107:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918528 00002000:00100000:3.0:1789126953.307161:0:8434:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff994105018000 x1876035258918528/t0(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:444/0 lens 504/0 e 0 to 0 dl 1789126964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789126953.307173:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994105018000 with x1876035258918528 ext(0->12) 00002000:00010000:3.0:1789126953.307179:0:8434:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994105018000 00000100:00100000:3.0:1789126953.307212:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1789126953.307222:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+11:2394:x1876035258918528:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789126953.315019:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2394:x1876035258918528:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 7787us (8006us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789126953.315054:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00002000:00100000:2.0:1789126953.315068:0:8434:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff994105018000 x1876035258918528/t4294967321(0) o4->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:444/0 lens 504/448 e 0 to 0 dl 1789126964 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789126953.315078:0:8434:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff994105018000 with x1876035258918528 ext(0->12) 00002000:00010000:2.0:1789126953.315085:0:8434:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff994105018000 00000100:00100000:2.0:1789126953.319387:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.319630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918656 00000100:00100000:1.0:1789126953.319640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918656 00000100:00100000:0.0:1789126953.320034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00100000:0.0:1789126953.320046:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+73:12718:x1876035258918656:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789126953.322233:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789126953.322260:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:2.0:1789126953.322333:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322345:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322352:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322359:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322364:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322372:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322389:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff994103ea9c00) 00010000:00010000:2.0:1789126953.322392:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126953.322397:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322403:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031200/0xa840b4da666eb721 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322460:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322468:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322474:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322479:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322482:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322488:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322498:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff994103ea9900) 00010000:00010000:2.0:1789126953.322500:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126953.322503:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322509:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666eb7c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322526:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322531:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322537:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322550:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322553:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322559:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322569:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:2.0:1789126953.322571:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126953.322574:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322581:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66200/0xa840b4da666eb847 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322603:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322610:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322616:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322621:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322624:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322630:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322681:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff994236490a00) 00010000:00010000:2.0:1789126953.322684:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126953.322688:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322694:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666eb86a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322724:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322730:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322736:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322741:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322744:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322750:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322758:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:2.0:1789126953.322761:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789126953.322764:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322770:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166c00/0xa840b4da666eb93c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322793:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322800:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322807:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322812:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789126953.322816:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322821:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322830:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:2.0:1789126953.322832:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789126953.322835:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.322841:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666eb9f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.323339:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276791040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789126953.323407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126953.323553:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276791040 00000100:00100000:2.0:1789126953.323560:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276791040 00000100:00100000:2.0:1789126953.323614:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789126953.323622:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276791040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789126953.323663:0:8906:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1789126953.323687:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.323725:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 12 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.323734:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789126953.323739:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789126953.323744:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.323769:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 12 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.323784:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 12 pid: 8906 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126953.323797:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276791168:192.168.203.23@tcp:104: 00000004:00080000:3.0:1789126953.323829:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789126953.323847:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994236520780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789126953.323851:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994104117900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994236520480 00000020:00080000:3.0:1789126953.323865:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994104117600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99410420a200 00000100:00100000:2.0:1789126953.323867:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789126953.323884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1789126953.323916:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994218106cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789126953.323921:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994220016d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994218106840 00000020:00080000:3.0:1789126953.323923:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994203e61a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994104324c00 00000020:00080000:3.0:1789126953.323934:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789126953.323964:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789126953.324021:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789126953.324124:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276791296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789126953.324154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126953.324262:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276791296 00000100:00100000:3.0:1789126953.324267:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276791296 00000100:00100000:3.0:1789126953.324309:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789126953.324316:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1876035276791296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789126953.324329:0:8430:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1789126953.324352:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3e927, atime: 0x6aa3e927, ctime: 0x6aa3e927, blocks: 0x8 00010000:00010000:3.0:1789126953.324357:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.324367:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789126953.324370:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126953.324375:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.324388:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.324404:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.324411:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.324427:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789126953.325261:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3641:x1876035276791296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 942us (1102us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789126953.325270:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1789126953.325295:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789126953.325301:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.325310:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126953.325313:0:9514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.325321:0:9514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.325336:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.325344:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eac85f46/0xa840b4da666eba2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.325370:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126953.325373:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126953.325375:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789126953.325383:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789126953.325469:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99410501c780/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789126953.325476:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12718:x1876035258918656:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 5432us (6097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126953.325476:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276791296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789126953.325484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 244 00000100:00100000:2.0:1789126953.325486:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126953.325491:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276791424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789126953.325522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126953.325557:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276791424 00000100:00100000:2.0:1789126953.325562:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276791424 00000100:00100000:2.0:1789126953.325588:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789126953.325595:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1876035276791424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789126953.325789:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789126953.325793:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789126953 00002000:00010000:2.0:1789126953.325795:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789126953.325797:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789126952 -> 1789126953 00002000:00010000:2.0:1789126953.325799:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789126953.325829:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1876035276791424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (307us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789126953.325835:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1789126953.325872:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104afa940/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789126953.325878:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276791424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789126953.328016:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.328045:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276791168:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789126953.328077:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.328091:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.328193:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918784 00000100:00100000:1.0:1789126953.328200:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918784 00010000:00010000:1.0:1789126953.328231:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 13 pid: 8906 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.328274:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258918912 00000100:00100000:1.0:1789126953.328274:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:3.0:1789126953.328279:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258918912 00000100:00100000:1.0:1789126953.328289:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:2393:x1876035258918784:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126953.328309:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789126953.328311:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00010000:00010000:1.0:1789126953.328317:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 14 pid: 8906 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.328333:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+14:2394:x1876035258918912:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.328354:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 14 pid: 8906 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.328379:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a754341a/0xa840b4da666eb7d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c687 expref: 14 pid: 8906 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.328394:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126953.328400:0:13969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126953.328406:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.328416:0:13969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.328448:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126953.328494:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+13:2393:x1876035258918784:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 208us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.328502:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00010000:00010000:3.0:1789126953.328539:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.328549:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.328557:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.328565:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.328585:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789126953.328985:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126953.328991:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.328999:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789126953.329002:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.329024:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.329039:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.329046:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671ba5fa/0xa840b4da666eba23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.329073:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126953.329075:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126953.329077:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126953.329463:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3640:x1876035276791040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5839us (6054us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789126953.329477:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1789126953.329547:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994104af8b40/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789126953.329555:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276791040:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789126953.330901:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789126953.330911:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789126953.331078:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2394:x1876035258918912:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 2754us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.331088:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:0.0:1789126953.333849:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.334086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919168 00000100:00100000:1.0:1789126953.334096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919168 00000100:00100000:1.0:1789126953.334154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 245 00000100:00100000:1.0:1789126953.334165:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12718:x1876035258919168:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.334217:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126953.334244:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c721 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.334261:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126953.334266:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789126953.334295:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.334321:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.334332:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789126953.334442:0:6514:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007ace2dde reply state 00000000d8062686 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.334454:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.334460:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126953.334463:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789126953.334465:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789126953.334560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:12718:x1876035258919168:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 396us (718us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789126953.334568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 245 00000100:00100000:0.0:1789126953.340674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.340731:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919296 00000100:00100000:2.0:1789126953.340740:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919296 00000100:00100000:2.0:1789126953.340802:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1789126953.340814:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2393:x1876035258919296:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789126953.341032:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789126953.341036:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789126953 -> 1789126952 00002000:00010000:2.0:1789126953.341039:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789126951 00002000:00010000:2.0:1789126953.341041:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789126953 -> 1789126952 00002000:00010000:2.0:1789126953.341056:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789126953.341119:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2393:x1876035258919296:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 307us (604us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789126953.341127:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1789126953.346904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.347428:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919552 00000100:00100000:1.0:1789126953.347438:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919552 00000100:00100000:1.0:1789126953.347504:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 246 00000100:00100000:1.0:1789126953.347514:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:12718:x1876035258919552:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789126953.347582:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.347600:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.347610:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.347698:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.347713:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.347728:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276791552:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126953.347806:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106000 going to sleep for 11 seconds 00000100:00100000:2.0:1789126953.352029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.352194:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919680 00000100:00100000:3.0:1789126953.352204:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919680 00010000:00010000:3.0:1789126953.352240:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.352282:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1789126953.352290:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:2393:x1876035258919680:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789126953.352311:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789126953.352319:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.352332:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.352353:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126953.352358:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.352368:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.352375:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.352413:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789126953.352458:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+23:2393:x1876035258919680:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 169us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.352466:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00010000:00010000:1.0:1789126953.352549:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67c00/0xa840b4da666eb9f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c713 expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.352573:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876035276791552:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126953.352596:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353740:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353753:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353876:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353885:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353903:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353909:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.353913:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353921:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353936:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126953.353939:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789126953.353943:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.353950:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba38 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.354038:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12718:x1876035258919552:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 6523us (7140us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789126953.354048:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 246 00000100:00100000:2.0:1789126953.356853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.356940:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919808 00000100:00100000:3.0:1789126953.356951:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919808 00000100:00100000:3.0:1789126953.357027:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1789126953.357038:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258919808:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789126953.357080:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.357099:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.357108:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789126953.357113:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789126953.357117:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.357152:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.357166:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 8 pid: 8430 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.357180:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276791680:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789126953.357272:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef600 going to sleep for 11 seconds 00000100:00100000:2.0:1789126953.361546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.361612:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258919936 00000100:00100000:1.0:1789126953.361622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258919936 00000100:00100000:3.0:1789126953.361683:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1876035276791680:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126953.361697:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 9 pid: 8430 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.361719:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.361812:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:1.0:1789126953.361823:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+9:2394:x1876035258919936:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126953.361837:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126953.361868:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 9 pid: 8430 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.361898:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 9 pid: 8430 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.361930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666eba1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c72f expref: 9 pid: 8430 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.361945:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126953.361950:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789126953.361954:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.361972:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.362000:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126953.362022:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362033:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.362044:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2394:x1876035258919936:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 224us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.362052:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00010000:00010000:3.0:1789126953.362054:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362064:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362078:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362085:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789126953.362089:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362098:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362124:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.362132:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eac85f46/0xa840b4da666eba3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.362178:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2391:x1876035258919808:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 5142us (5335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.362187:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:0.0:1789126953.365478:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.365569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258920192 00000100:00100000:3.0:1789126953.365578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258920192 00000100:00100000:3.0:1789126953.365638:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:3.0:1789126953.366368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:12718:x1876035258920192:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789126953.366586:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.366604:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.366613:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.366711:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.366729:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 21 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126953.366742:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276791808:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789126953.366937:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789126953.370575:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276791808:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789126953.370609:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.373544:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.373600:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258920320 00000100:00100000:2.0:1789126953.373618:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258920320 00010000:00010000:2.0:1789126953.373696:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126953.373751:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:2.0:1789126953.373761:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:2393:x1876035258920320:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789126953.373937:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789126953.373947:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.373961:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.373983:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66800/0xa840b4da666eb935 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6db expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.373997:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:2.0:1789126953.374003:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.374012:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.374020:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.374028:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.374066:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789126953.374129:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:2393:x1876035258920320:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 369us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126953.374146:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00010000:00010000:0.0:1789126953.374176:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374184:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374328:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374345:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374354:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374381:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.374394:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 21 pid: 6513 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.374407:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276791936:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789126953.374460:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520000 going to sleep for 11 seconds 00000100:00100000:0.0:1789126953.379280:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276791936:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789126953.379331:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.379508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.379584:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258920448 00000100:00100000:0.0:1789126953.379591:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258920448 00010000:00010000:0.0:1789126953.379629:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 22 pid: 6513 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.379694:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:0.0:1789126953.379704:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:2393:x1876035258920448:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126953.379719:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126953.379738:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 22 pid: 6513 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.379750:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 22 pid: 6513 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.379773:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c71a expref: 22 pid: 6513 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.380101:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:0.0:1789126953.380107:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.380116:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.380123:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.380158:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789126953.380274:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.380282:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789126953.380397:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789126953.380514:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789126953.380576:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789126953.380678:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276792064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789126953.380747:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126953.380778:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef900 going to sleep for 11 seconds 00000100:00100000:0.0:1789126953.380835:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:2393:x1876035258920448:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1130us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126953.380844:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:1.0:1789126953.382357:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276792064 00000100:00100000:1.0:1789126953.382368:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276792064 00000100:00100000:1.0:1789126953.382419:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789126953.382430:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1876035276792064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789126953.382542:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1876035276792064:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.382549:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789126953.382672:0:6512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789126953.382679:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1789126953.382932:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104afa940, transno 4294967322 00000100:00100000:3.0:1789126953.382959:0:6512:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff994104af8b40 x1876035276791040/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789126969 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126953.382972:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276792064:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789126953.383239:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1789126953.383299:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276792192:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789126953.383340:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126953.383416:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef000 going to sleep for 11 seconds 00000100:00100000:1.0:1789126953.383454:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276792192 00000100:00100000:1.0:1789126953.383459:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276792192 00000100:00100000:1.0:1789126953.383497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789126953.383505:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1876035276792192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789126953.384243:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6512:x1876035276792192:12345-0@lo:1000:mdt00_000.0 Request processed in 734us (897us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789126953.384253:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789126953.384336:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876035276792192:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789126953.384376:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384386:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384395:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384403:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126953.384407:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384416:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384443:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:3.0:1789126953.384446:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789126953.384451:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384457:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166800/0xa840b4da666eba4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384483:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384490:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384495:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384500:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126953.384503:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384509:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384517:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126953.384519:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789126953.384526:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384537:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384638:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126953.384697:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126953.384721:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276792320:192.168.203.23@tcp:105: 00000100:00100000:3.0:1789126953.384986:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef000 going to sleep for 11 seconds 00010000:00010000:0.0:1789126953.387901:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126953.388905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.389287:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876035276792320:192.168.203.23@tcp:105: 00010000:00010000:0.0:1789126953.389320:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389343:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666eb990 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389379:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389393:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389405:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389416:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389422:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389429:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389434:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.389438:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389445:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389458:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126953.389461:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789126953.389465:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389479:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666eba54 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389491:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389497:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389503:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389509:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789126953.389512:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389518:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389526:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126953.389529:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789126953.389531:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.389537:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2c00/0xa840b4da666eba46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.389746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:12718:x1876035258920192:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 24090us (24266us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789126953.389756:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 247 00000020:00080000:0.0:1789126953.389768:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789126953.389902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258920576 00000100:00100000:1.0:1789126953.389911:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258920576 00000100:00100000:1.0:1789126953.389964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1789126953.389974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:12717:x1876035258920576:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:1.0:1789126953.390061:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+24:12717:x1876035258920576:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 89us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.390069:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000040:00080000:3.0:1789126953.393409:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126953.393422:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126953.393954:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1789126953.393966:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789126953.396280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126953.396330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126953.396388:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258920832 00000100:00100000:1.0:1789126953.396393:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921088 00000100:00100000:3.0:1789126953.396399:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258920832 00000100:00100000:1.0:1789126953.396400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921088 00000100:00100000:1.0:1789126953.396502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1789126953.396504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:3.0:1789126953.396520:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12717:x1876035258920832:12345-192.168.203.23@tcp:58:lfs.0 00000100:00100000:1.0:1789126953.396567:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212267850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+25:12718:x1876035258921088:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789126953.396879:0:6516:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789126953.396912:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1789126953.396946:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.396963:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.396974:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.396983:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789126953.397004:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00010000:00010000:1.0:1789126953.397023:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.397029:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.397054:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789126953.397090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12717:x1876035258920832:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 573us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126953.397100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 248 00000100:00100000:1.0:1789126953.397115:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212267850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:12718:x1876035258921088:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 550us (782us total) trans 4294967516 rc 0/0 00010000:00010000:2.0:1789126953.397273:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126953.397280:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.397289:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789126953.397293:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.397302:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.397316:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:2.0:1789126953.397320:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789126953.397325:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.397330:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba5b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126953.397343:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126953.397345:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126953.397347:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126953.401277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000020:00080000:1.0:1789126953.401292:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789126953.424218:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.424474:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921216 00000100:00100000:1.0:1789126953.424484:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921216 00000100:00100000:1.0:1789126953.424539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:1.0:1789126953.424550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+26:12720:x1876035258921216:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789126953.424573:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126953.424593:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eba62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c736 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424685:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424709:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424721:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424736:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424759:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424767:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424837:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424849:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424868:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424902:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.424915:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 27 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.424929:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276792448:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789126953.425031:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106900 going to sleep for 11 seconds 00000100:00100000:3.0:1789126953.430965:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126953.431046:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921472 00000100:00100000:0.0:1789126953.431056:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921472 00000100:00100000:0.0:1789126953.431111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1789126953.431121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:6159:x1876035258921472:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789126953.431207:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876035276792448:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789126953.431232:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789126953.431363:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:6159:x1876035258921472:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 243us (408us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789126953.431371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1789126953.439056:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126953.439154:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921600 00000100:00100000:1.0:1789126953.439177:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921600 00010000:00010000:1.0:1789126953.439586:0:13969:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 29 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789126953.439632:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1789126953.439643:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:2393:x1876035258921600:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126953.439899:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126953.439910:0:13969:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 29 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.439923:0:13969:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 29 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.439945:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167800/0xa840b4da666eb982 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6f7 expref: 29 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.439962:0:13969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126953.439968:0:13969:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.439979:0:13969:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.439987:0:13969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126953.440198:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126953.440264:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:2393:x1876035258921600:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 622us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126953.440272:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00010000:00010000:1.0:1789126953.440550:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440560:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789126953.440607:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789126953.440611:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789126953.440630:0:6514:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440643:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440740:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440747:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440754:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440760:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126953.440764:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440780:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440791:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126953.440794:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126953.440797:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440803:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396000/0xa840b4da666eba69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440817:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440823:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440829:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440835:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126953.440838:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440842:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440849:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99420a83d300) 00010000:00010000:1.0:1789126953.440851:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126953.440862:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440878:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396e00/0xa840b4da666eba70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440916:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396a00/0xa840b4da666eba62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c736 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440930:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c736 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126953.440938:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126953.440941:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126953.440943:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396200, rc 0) 00000100:00100000:1.0:1789126953.441167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12720:x1876035258921216:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 16617us (16956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126953.441175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 249 00000040:00080000:3.0:1789126954.191103:0:15444:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126954.191115:0:15444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126954.191160:0:15444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1789126954.191168:0:15444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789126954.410870:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789126954.410880:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789126954.410904:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1789126954.410916:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126954.411053:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276792576:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789126954.411216:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e2bde40 going to sleep for 11 seconds 00010000:00010000:3.0:1789126954.412307:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126954.420531:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126954.420624:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921728 00000100:00100000:0.0:1789126954.420634:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921728 00000100:00100000:0.0:1789126954.420736:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 250 00000100:00100000:0.0:1789126954.420745:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:12733:x1876035258921728:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789126954.420781:0:9524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789126954.420913:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+28:12733:x1876035258921728:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 168us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126954.420922:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 250 00000100:00100000:3.0:1789126954.421784:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14482:1876035276792576:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789126954.432122:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126954.433230:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258921984 00000100:00100000:0.0:1789126954.433245:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258921984 00000100:00100000:0.0:1789126954.433317:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:0.0:1789126954.433329:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+27:12733:x1876035258921984:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789126954.433350:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126954.433372:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eba7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c73d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126954.433476:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eba85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126954.433491:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eba85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126954.433503:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eba85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126954.433518:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789126954.433634:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eba7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c73d expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126954.433677:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eba85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c73d expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126954.433685:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126954.433687:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789126954.433690:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166400, rc 0) 00000100:00100000:0.0:1789126954.433749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:12733:x1876035258921984:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 424us (1646us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789126954.433755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:2.0:1789126954.439416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126954.439970:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258922240 00000100:00100000:0.0:1789126954.439983:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258922240 00000100:00100000:0.0:1789126954.440062:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:0.0:1789126954.440076:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:12733:x1876035258922240:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789126954.440318:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126954.440343:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126954.440357:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789126954.440488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:1.0:1789126954.440585:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126954.440587:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258922368 00000100:00100000:3.0:1789126954.440595:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258922368 00010000:00010000:1.0:1789126954.440600:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126954.440627:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126954.440633:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126954.440639:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126954.440675:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126954.440684:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:1.0:1789126954.440706:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00000100:00100000:3.0:1789126954.440707:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+31:2392:x1876035258922368:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126954.440716:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789126954.440724:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126954.440731:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126954.440732:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397a00/0xa840b4da666eba93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126954.440765:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666eba85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c73d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126954.440844:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126954.440859:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126954.440898:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:12733:x1876035258922240:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 820us (1491us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789126954.440909:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:2392:x1876035258922368:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 206us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.440918:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:3.0:1789126954.440930:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000040:00080000:0.0:1789126954.441299:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789126954.441305:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789126954.442047:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1789126954.442058:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789126954.452818:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126954.452934:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258922624 00000100:00100000:0.0:1789126954.452949:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258922624 00000100:00100000:0.0:1789126954.453024:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1789126954.453038:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+29:12733:x1876035258922624:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789126954.453359:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:12733:x1876035258922624:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 323us (553us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789126954.453374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1789126954.668404:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126954.668432:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276792704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126954.668519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.668606:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276792704 00000100:00100000:1.0:1789126954.668614:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276792704 00000100:00100000:1.0:1789126954.668702:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789126954.668714:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876035276792704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789126954.668743:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789126954.668812:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876035276792704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.668821:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789126954.668892:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276792704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126954.669176:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276792832:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669286:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994209581680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276793344:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669315:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669336:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276793856:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669379:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789126954.669384:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276793216:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669423:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276793728:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669455:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276794240:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126954.669499:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793344 00000100:00100000:1.0:1789126954.669504:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793344 00000100:00100000:1.0:1789126954.669533:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789126954.669540:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276793344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669582:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276793344:12345-0@lo:400:kworker.0 Request processed in 42us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.669589:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789126954.669609:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793856 00000100:00100000:1.0:1789126954.669622:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793856 00000100:00100000:1.0:1789126954.669741:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793728 00000100:00100000:1.0:1789126954.669745:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793728 00000100:00100000:1.0:1789126954.669767:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794240 00000100:00100000:1.0:1789126954.669769:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794240 00000100:00100000:1.0:1789126954.669783:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789126954.669789:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3640:x1876035276793856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669820:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3640:x1876035276793856:12345-0@lo:400:kworker.0 Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.669827:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789126954.669837:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789126954.669842:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276793728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669879:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276793728:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.669885:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789126954.669895:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789126954.669900:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276794240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.669924:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276794240:12345-0@lo:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.669929:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789126954.669948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793216 00000100:00100000:1.0:1789126954.669951:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793216 00000100:00100000:1.0:1789126954.669979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789126954.669985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276793216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.670014:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276793216:12345-0@lo:400:kworker.0 Request processed in 29us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126954.670020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789126954.670066:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276793216:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.670076:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276793728:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.670085:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276794240:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.670093:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994209581680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276793344:0@lo:400:kworker.0 00000100:00100000:1.0:1789126954.670102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276793856:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670390:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276793088:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126954.670447:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276793600:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126954.670481:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276794112:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126954.670523:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789126954.670529:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276792960:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126954.670560:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276793472:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126954.670589:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276793984:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670606:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789126954.670626:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789126954.670630:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126954.670668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793088 00000100:00100000:3.0:1789126954.670673:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793088 00000100:00100000:3.0:1789126954.670698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789126954.670704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670739:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276793088:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.670745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789126954.670762:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793600 00000100:00100000:3.0:1789126954.670765:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793600 00000100:00100000:3.0:1789126954.670783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794112 00000100:00100000:3.0:1789126954.670785:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794112 00000100:00100000:3.0:1789126954.670797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276792960 00000100:00100000:3.0:1789126954.670799:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276792960 00000100:00100000:3.0:1789126954.670809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793472 00000100:00100000:3.0:1789126954.670811:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793472 00000100:00100000:3.0:1789126954.670821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276793984 00000100:00100000:3.0:1789126954.670823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276793984 00000100:00100000:3.0:1789126954.670834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789126954.670839:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276793600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670889:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276793600:12345-0@lo:400:kworker.0 Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.670895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789126954.670907:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789126954.670912:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276794112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276794112:12345-0@lo:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.670940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789126954.670952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789126954.670958:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276792960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.670983:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276792960:12345-0@lo:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.670989:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789126954.671000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789126954.671005:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276793472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.671031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276793472:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.671036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789126954.671048:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789126954.671054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.671080:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276793984:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126954.671086:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:3.0:1789126954.671112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789126954.671115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789126954.671150:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276792960:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.671160:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276793472:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.671169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276793984:0@lo:400:kworker.0 00000100:00100000:3.0:1789126954.671179:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276793088:0@lo:400:kworker.0 00010000:00080000:3.0:1789126954.671190:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa812c0 x1876035276793600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126954.671201:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276793600:0@lo:400:kworker.0 00010000:00080000:3.0:1789126954.671211:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa830c0 x1876035276794112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126954.671220:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276794112:0@lo:400:kworker.0 00000100:00100000:2.0:1789126954.671441:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126954.671453:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276794368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126954.671492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126954.671524:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794368 00000100:00100000:2.0:1789126954.671529:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794368 00000100:00100000:2.0:1789126954.671560:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789126954.671567:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276794368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789126954.671584:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1789126954.671618:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276794368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126954.671625:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789126954.671674:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276794368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126954.672417:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276792832 00000100:00100000:0.0:1789126954.672427:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276792832 00000100:00100000:0.0:1789126954.672476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1789126954.672485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276792832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126954.672555:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942404ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3640:x1876035276792832:12345-0@lo:400:kworker.0 Request processed in 71us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126954.672562:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789126954.672684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276792832:0@lo:400:kworker.0 00000001:00080000:3.0:1789126954.677748:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789126954.677780:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:1.0:1789126955.243879:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789126955.438567:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789126955.499033:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126955.499048:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789126955.499318:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789126955.499329:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789126955.965142:0:15496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789126955.965152:0:15496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789126955.965459:0:15496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789126955.965467:0:15496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789126956.100821:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126956.101958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258922880 00000100:00100000:0.0:1789126956.101980:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258922880 00000100:00100000:0.0:1789126956.102118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 253 00000100:00100000:0.0:1789126956.102129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+30:12753:x1876035258922880:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789126956.102158:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789126956.102179:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eba9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c744 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126956.102277:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ebaa1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126956.102293:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ebaa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126956.102308:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ebaa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789126956.102318:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789126956.102421:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666eba9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c744 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126956.102437:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ebaa1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c744 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126956.102445:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:0.0:1789126956.102448:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789126956.102452:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166a00, rc 0) 00000100:00100000:0.0:1789126956.102510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:12753:x1876035258922880:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 383us (1699us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789126956.102518:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 253 00000100:00080000:3.0:1789126956.103012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126956.108672:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126956.108707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923008 00000100:00100000:3.0:1789126956.108717:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923008 00000100:00100000:3.0:1789126956.108782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:3.0:1789126956.108793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:12753:x1876035258923008:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1789126956.108876:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108894:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108906:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108950:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108956:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108962:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108980:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789126956.108984:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.108991:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.109003:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:3.0:1789126956.109006:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789126956.109023:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126956.109029:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66a00/0xa840b4da666ebaaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789126956.109102:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:12753:x1876035258923008:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 311us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126956.109110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:0.0:1789126956.199642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126956.201910:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923136 00000100:00100000:1.0:1789126956.201926:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923136 00000100:00100000:1.0:1789126956.202026:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1789126956.202043:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2392:x1876035258923136:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:1.0:1789126956.202064:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789126956.202086:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b03c50a/0xa840b4da666ebab6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c74b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789126956.202109:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3e928, atime: 0x6aa3e927, ctime: 0x6aa3e928, blocks: 0x8 00010000:00010000:1.0:1789126956.202128:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789126956.202133:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789126956.202142:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b03c50a/0xa840b4da666ebab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c74b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126956.202181:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b03c50a/0xa840b4da666ebab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c74b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126956.202196:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397400, rc 0) 00000100:00100000:1.0:1789126956.202273:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2392:x1876035258923136:12345-192.168.203.23@tcp:101:cat.0 Request processed in 236us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126956.202281:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00080000:3.0:1789126956.202504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126956.213508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126956.213618:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923264 00000100:00100000:1.0:1789126956.213630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923264 00002000:00100000:1.0:1789126956.213726:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff99410501f0c0 x1876035258923264/t0(0) o3->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:447/0 lens 488/0 e 0 to 0 dl 1789126967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126956.213738:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99410501f0c0 with x1876035258923264 ext(0->4095) 00002000:00010000:1.0:1789126956.213745:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99410501f0c0 00000100:00100000:1.0:1789126956.213780:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1789126956.213790:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258923264:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:1.0:1789126956.213971:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258923264:12345-192.168.203.23@tcp:3:cat.0 Request processed in 182us (470us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789126956.213980:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00002000:00100000:1.0:1789126956.213986:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff99410501f0c0 x1876035258923264/t0(0) o3->7cbe914d-2346-44a4-9fd5-22d31c7628a2@192.168.203.23@tcp:447/0 lens 488/4536 e 0 to 0 dl 1789126967 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789126956.213996:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99410501f0c0 with x1876035258923264 ext(0->4095) 00002000:00010000:1.0:1789126956.213999:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99410501f0c0 00010000:00010000:0.0:1789126956.459203:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126956.715139:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126956.715173:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276794496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789126956.715242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126956.715352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794496 00000100:00100000:1.0:1789126956.715372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794496 00000100:00100000:1.0:1789126956.715417:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789126956.715426:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994210e42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276794496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789126956.715474:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789126956.721124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994210e42850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276794496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5690us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126956.721140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789126956.729031:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276794496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126957.227046:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126957.227069:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276794624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789126957.227136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126957.227211:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794624 00000100:00100000:2.0:1789126957.227219:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794624 00000100:00100000:2.0:1789126957.227273:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789126957.227283:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276794624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126957.227310:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126957.227351:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276794624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126957.227358:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1789126957.227384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789126957.227409:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789126957.227414:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1789126957.227443:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104b40000, transno 4294967308 00000004:00080000:2.0:1789126957.227453:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789126957.227462:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99410501c780, transno 4294967311 00000100:00100000:2.0:1789126957.227474:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276794624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789126957.228005:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126957.228025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276794752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126957.228062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126957.228098:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794752 00000100:00100000:1.0:1789126957.228102:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794752 00000100:00100000:1.0:1789126957.228133:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789126957.228139:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d85e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276794752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126957.228150:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126957.228190:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d85e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276794752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126957.228196:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789126957.228397:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126957.228420:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276794752:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789126957.483497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126958.251090:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126958.251113:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276794880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126958.251181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126958.251274:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276794880 00000100:00100000:2.0:1789126958.251281:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276794880 00000100:00100000:2.0:1789126958.251331:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789126958.251340:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276794880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126958.251370:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789126958.251419:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276794880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126958.251427:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789126958.251472:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276794880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789126958.416080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416123:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416179:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416219:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126958.416267:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923904 00000100:00100000:0.0:1789126958.416275:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923904 00000100:00100000:0.0:1789126958.416326:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923776 00000100:00100000:0.0:1789126958.416330:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923776 00000100:00100000:0.0:1789126958.416384:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1789126958.416394:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258923904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126958.416463:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+8:2391:x1876035258923904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126958.416472:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1789126958.416489:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:0.0:1789126958.416495:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258923776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.416600:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923392 00000100:00100000:1.0:1789126958.416604:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923392 00000100:00100000:1.0:1789126958.416634:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 448 00000100:00100000:1.0:1789126958.416641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258923392:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.416692:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258923392:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 50us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126958.416709:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 448 00000100:00080000:1.0:1789126958.416752:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789126958.416756:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789126958.416766:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923648 00000100:00100000:1.0:1789126958.416769:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923648 00000100:00100000:1.0:1789126958.416795:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924160 00000100:00100000:1.0:1789126958.416798:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924160 00000100:00100000:1.0:1789126958.416811:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258923520 00000100:00100000:1.0:1789126958.416813:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258923520 00000100:00100000:1.0:1789126958.416837:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924032 00000100:00100000:1.0:1789126958.416839:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924032 00000100:00100000:1.0:1789126958.416854:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 328 00000100:00100000:1.0:1789126958.416861:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258923648:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.416890:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258923648:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126958.416896:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 328 00000100:00100000:1.0:1789126958.416909:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 329 00000100:00100000:1.0:1789126958.416915:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258924160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.416939:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258924160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126958.416945:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 329 00000100:00100000:1.0:1789126958.416956:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 330 00000100:00100000:1.0:1789126958.416962:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:2391:x1876035258923520:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.416986:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+32:2391:x1876035258923520:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126958.416991:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 330 00000100:00100000:1.0:1789126958.417010:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 331 00000100:00100000:1.0:1789126958.417016:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258924032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126958.417040:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258924032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126958.417045:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 331 00000100:00080000:1.0:1789126958.417066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789126958.417069:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789126958.417208:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258923776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126958.417217:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00010000:00010000:3.0:1789126958.511282:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789126958.767855:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789126958.767870:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789126958.770479:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789126958.770520:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994213bef900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789126958.770535:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99423e0c0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994213befe40 00000020:00080000:3.0:1789126958.770539:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99423e0c0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99423d2a9c00 00000020:00080000:3.0:1789126958.770565:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789126958.770802:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789126958.770877:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789126958.772026:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772041:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772048:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772054:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789126958.772059:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772067:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772083:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff994236490600) 00010000:00010000:1.0:1789126958.772088:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126958.772093:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126958.772099:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397600/0xa840b4da666eba31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126959.530861:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126959.786912:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276795008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126959.786980:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.787051:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795008 00000100:00100000:3.0:1789126959.787058:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795008 00000100:00100000:3.0:1789126959.787110:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789126959.787120:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276795008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789126959.787147:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789126959.787189:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276795008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126959.787196:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789126959.787217:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126959.787250:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276795008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789126959.788306:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789126959.788318:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789126959.788359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.788408:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795136 00000100:00100000:3.0:1789126959.788413:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795136 00000100:00100000:3.0:1789126959.788451:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789126959.788459:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276795136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789126959.788475:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789126959.788513:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276795136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126959.788520:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789126959.788537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789126959.788558:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789126959.788563:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994104af8b40, transno 4294967323 00000004:00080000:3.0:1789126959.788574:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789126959.788597:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789126959.789191:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276795264:0@lo:400:kworker.0 00000100:00100000:0.0:1789126959.789229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.789449:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276795392:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.789478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126959.789541:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795264 00000100:00100000:1.0:1789126959.789547:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795264 00000100:00100000:1.0:1789126959.789585:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789126959.789592:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276795264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.791351:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276795904:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.791404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126959.791434:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276796416:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.791457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126959.791479:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789126959.791485:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276795776:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.791519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126959.791539:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276796288:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.791562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.791637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276795520:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.791688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.791706:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276796032:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.791727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.791753:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276796544:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.791774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.791787:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789126959.791792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276795648:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.791821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126959.791833:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276796160:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.791865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126959.792024:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795776 00000100:00100000:2.0:1789126959.792031:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795776 00000100:00100000:2.0:1789126959.792068:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795520 00000100:00100000:2.0:1789126959.792072:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795520 00000100:00100000:2.0:1789126959.792088:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789126959.792096:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276795776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792147:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276795776:12345-0@lo:400:kworker.0 Request processed in 51us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792153:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789126959.792169:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789126959.792176:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276795520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792203:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276795520:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792209:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789126959.792226:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795392 00000100:00100000:2.0:1789126959.792230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795392 00000100:00100000:2.0:1789126959.792248:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795904 00000100:00100000:2.0:1789126959.792251:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795904 00000100:00100000:2.0:1789126959.792270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796416 00000100:00100000:2.0:1789126959.792273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796416 00000100:00100000:2.0:1789126959.792284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796032 00000100:00100000:2.0:1789126959.792286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796032 00000100:00100000:2.0:1789126959.792297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796544 00000100:00100000:2.0:1789126959.792300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796544 00000100:00100000:2.0:1789126959.792311:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276795648 00000100:00100000:2.0:1789126959.792313:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276795648 00000100:00100000:2.0:1789126959.792335:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789126959.792341:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276795392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792375:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276795392:12345-0@lo:400:kworker.0 Request processed in 34us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789126959.792393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789126959.792399:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276795904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792427:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276795904:12345-0@lo:400:kworker.0 Request processed in 29us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789126959.792444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789126959.792450:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276796416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792477:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276796416:12345-0@lo:400:kworker.0 Request processed in 28us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789126959.792496:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789126959.792502:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276796032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276796032:12345-0@lo:400:kworker.0 Request processed in 28us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789126959.792546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789126959.792552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276796544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276796544:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789126959.792603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789126959.792609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276795648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792638:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276795648:12345-0@lo:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126959.792644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:2.0:1789126959.792682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789126959.792686:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126959.792794:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276795776:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792807:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276795904:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792827:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276796416:0@lo:400:kworker.0 00000100:00100000:2.0:1789126959.792837:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276795392:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.793031:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276795520:0@lo:400:kworker.0 00010000:00080000:3.0:1789126959.793043:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994105019680 x1876035276796032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126959.793054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276796032:0@lo:400:kworker.0 00010000:00080000:3.0:1789126959.793063:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030761c0 x1876035276796544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126959.793071:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276796544:0@lo:400:kworker.0 00000100:00100000:3.0:1789126959.793089:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276795648:0@lo:400:kworker.0 00000100:00100000:1.0:1789126959.795111:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276795264:12345-0@lo:400:kworker.0 Request processed in 5511us (5872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126959.795126:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789126959.795176:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796288 00000100:00100000:1.0:1789126959.795184:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796288 00000100:00100000:1.0:1789126959.795243:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796160 00000100:00100000:1.0:1789126959.795246:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796160 00000100:00100000:1.0:1789126959.795269:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789126959.795277:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276796288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126959.795342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276796288:12345-0@lo:400:kworker.0 Request processed in 66us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126959.795349:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789126959.795361:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789126959.795367:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276796160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126959.795398:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276796160:12345-0@lo:400:kworker.0 Request processed in 31us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126959.795404:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789126959.795445:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276796288:0@lo:400:kworker.0 00000100:00100000:1.0:1789126959.795474:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276796160:0@lo:400:kworker.0 00000100:00080000:2.0:1789126959.795558:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789126959.795596:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276795264:0@lo:400:kworker.0 00000100:00100000:1.0:1789126960.194399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126960.195036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924288 00000100:00100000:2.0:1789126960.195048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924288 00000100:00100000:2.0:1789126960.195135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00100000:2.0:1789126960.195146:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:12406:x1876035258924288:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789126960.195269:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:12406:x1876035258924288:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 125us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126960.195277:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00080000:3.0:1789126960.195336:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126960.202946:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126960.203450:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924416 00000100:00100000:1.0:1789126960.203703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924416 00000100:00080000:3.0:1789126960.203831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789126960.203867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:1.0:1789126960.203879:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:12406:x1876035258924416:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789126960.204177:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:12406:x1876035258924416:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 300us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126960.204186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:0.0:1789126960.218902:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126960.218976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924672 00000100:00100000:2.0:1789126960.218986:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924672 00000100:00100000:2.0:1789126960.219090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:2.0:1789126960.219102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:12406:x1876035258924672:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789126960.219366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:12406:x1876035258924672:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 267us (474us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789126960.219375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1789126960.409242:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126960.409353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924800 00000100:00100000:2.0:1789126960.409368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924800 00000100:00100000:2.0:1789126960.409548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 257 00000100:00100000:2.0:1789126960.409560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:13210:x1876035258924800:12345-192.168.203.23@tcp:101:lsof.0 00010000:00010000:2.0:1789126960.409580:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789126960.409601:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666ebabd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c752 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409693:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409708:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409720:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789126960.409765:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789126960.409769:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789126960.409792:0:6513:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409826:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2600/0xa840b4da666ebabd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c752 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409844:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c752 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126960.409866:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:2.0:1789126960.409869:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126960.409873:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3200, rc 0) 00000100:00100000:2.0:1789126960.409941:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+6:13210:x1876035258924800:12345-192.168.203.23@tcp:101:lsof.0 Request processed in 383us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126960.409948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 257 00000100:00080000:3.0:1789126960.410370:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789126960.554946:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126961.579230:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126961.835709:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789126961.835816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126961.836080:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796672 00000100:00100000:3.0:1789126961.836091:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796672 00000100:00100000:3.0:1789126961.836176:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789126961.836187:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276796672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789126961.836234:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789126961.836310:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276796672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126961.836318:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789126961.837475:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126962.346904:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789126962.346942:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276796800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789126962.347052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126962.347162:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796800 00000100:00100000:2.0:1789126962.347174:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796800 00000100:00100000:2.0:1789126962.347251:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789126962.347265:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276796800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126962.347299:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126962.347372:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276796800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126962.347379:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789126962.347403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126962.347540:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789126962.347556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276796928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126962.347600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126962.347884:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276796800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789126962.347897:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276796928 00000100:00100000:2.0:1789126962.347904:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276796928 00000100:00100000:2.0:1789126962.347960:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789126962.347970:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276796928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126962.347985:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126962.348042:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276796928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126962.348067:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789126962.348248:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126962.349864:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276796928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789126962.603826:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789126962.939464:0:15693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:42:41 (1789126961) 00000100:00100000:3.0:1789126963.370880:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789126963.370912:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276797056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126963.371008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126963.371127:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797056 00000100:00100000:2.0:1789126963.371137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797056 00000100:00100000:2.0:1789126963.371203:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789126963.371215:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276797056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126963.371259:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789126963.371332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276797056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126963.371340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789126963.371393:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276797056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789126963.533770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126963.533830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126963.533862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126963.533892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126963.533934:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126963.533962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126963.534369:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925056 00000100:00100000:0.0:1789126963.534383:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925056 00000100:00100000:2.0:1789126963.534384:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925568 00000100:00100000:2.0:1789126963.534391:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925568 00000100:00100000:3.0:1789126963.534451:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126963.534460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925184 00000100:00100000:0.0:1789126963.534466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925184 00000100:00100000:0.0:1789126963.534494:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925696 00000100:00100000:0.0:1789126963.534497:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925696 00000100:00100000:3.0:1789126963.534504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 338 00000100:00100000:0.0:1789126963.534530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 339 00000100:00100000:3.0:1789126963.534532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:2391:x1876035258925056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126963.534547:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258925184:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789126963.534600:0:9524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789126963.534612:0:9524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789126963.534630:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:2391:x1876035258925056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 112us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126963.534639:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 338 00000100:00100000:3.0:1789126963.534707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 340 00000100:00100000:3.0:1789126963.534717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258925696:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126963.534799:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258925184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 247us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126963.534815:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 339 00000100:00100000:0.0:1789126963.534837:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 341 00000100:00100000:0.0:1789126963.534846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2391:x1876035258925568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789126963.536797:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258924928 00000100:00100000:1.0:1789126963.536814:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258924928 00000100:00100000:1.0:1789126963.536896:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 450 00000100:00100000:1.0:1789126963.536908:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258924928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789126963.537826:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2391:x1876035258925696:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 3100us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126963.537841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 340 00000100:00080000:3.0:1789126963.537890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126963.537895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126963.541173:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2391:x1876035258925568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 6309us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126963.541191:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 341 00000100:00100000:0.0:1789126963.541264:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925312 00000100:00100000:0.0:1789126963.541275:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925312 00000100:00100000:0.0:1789126963.541339:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925440 00000100:00100000:0.0:1789126963.541343:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925440 00000100:00100000:0.0:1789126963.541368:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:0.0:1789126963.541377:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258925312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126963.541438:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2391:x1876035258925312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 61us (7609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126963.541445:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:0.0:1789126963.541460:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:0.0:1789126963.541466:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2391:x1876035258925440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789126963.541492:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2391:x1876035258925440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (7530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126963.541498:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00080000:0.0:1789126963.541998:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789126963.542004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126963.543843:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2391:x1876035258924928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 6922us (9935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126963.543863:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 450 00010000:00010000:3.0:1789126963.631908:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126964.662166:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126964.907264:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789126964.907285:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276797568:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907357:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276797312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789126964.907375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126964.907465:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276797440:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.907639:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276797696:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907699:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276797824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.907701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.907729:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276798208:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126964.907766:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276798336:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.907766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.907804:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276798720:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.907838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126964.907843:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276798848:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.907875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.907875:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789126964.907885:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276798080:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.907914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126964.907919:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797312 00000100:00100000:3.0:1789126964.907927:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797312 00000100:00100000:2.0:1789126964.907937:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276798592:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.907964:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126964.908004:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789126964.908007:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797696 00000100:00100000:2.0:1789126964.908012:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797696 00000100:00100000:3.0:1789126964.908017:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276797312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126964.908044:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798080 00000100:00100000:2.0:1789126964.908049:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798080 00002000:00000024:3.0:1789126964.908050:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789126964.908071:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798592 00000100:00100000:2.0:1789126964.908075:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798592 00000100:00100000:2.0:1789126964.908094:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789126964.908101:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276797312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908104:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276797696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908117:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789126964.908144:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797568 00000100:00100000:3.0:1789126964.908149:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797568 00000100:00100000:2.0:1789126964.908158:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276797696:12345-0@lo:400:kworker.0 Request processed in 55us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908165:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789126964.908175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797824 00000100:00100000:3.0:1789126964.908179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797824 00000100:00100000:2.0:1789126964.908186:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789126964.908195:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276798080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908201:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789126964.908225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276797568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.908231:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276798080:12345-0@lo:400:kworker.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908239:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789126964.908254:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789126964.908262:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276798592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276797568:12345-0@lo:400:kworker.0 Request processed in 73us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126964.908291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789126964.908302:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276798592:12345-0@lo:400:kworker.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126964.908308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789126964.908312:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789126964.908321:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276797824:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789126964.908355:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410480a940 x1876035276798080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126964.908358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276797824:12345-0@lo:400:kworker.0 Request processed in 39us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908372:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276798080:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908375:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:2.0:1789126964.908391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104808000 x1876035276798592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789126964.908401:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798208 00000100:00100000:3.0:1789126964.908407:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798208 00000100:00100000:2.0:1789126964.908418:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276798592:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908432:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798336 00000100:00100000:2.0:1789126964.908436:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276797696:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908438:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798336 00000100:00100000:3.0:1789126964.908460:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798720 00000100:00100000:3.0:1789126964.908464:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798720 00000100:00100000:3.0:1789126964.908480:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798848 00000100:00100000:3.0:1789126964.908483:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798848 00000100:00100000:3.0:1789126964.908496:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789126964.908502:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276798208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.908849:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789126964.908859:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276798336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.908897:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276798336:12345-0@lo:400:kworker.0 Request processed in 40us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908903:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789126964.908918:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789126964.908924:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276798720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.908955:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276798720:12345-0@lo:400:kworker.0 Request processed in 30us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908961:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789126964.908973:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789126964.908979:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276798208:12345-0@lo:400:kworker.0 Request processed in 474us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.908983:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276798848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.908993:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789126964.909020:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276798848:12345-0@lo:400:kworker.0 Request processed in 39us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.909027:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789126964.909091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276797312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789126964.909154:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276797824:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.909166:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276798336:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.909177:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276798848:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.909195:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276798208:0@lo:400:kworker.0 00000100:00100000:3.0:1789126964.909225:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276798720:0@lo:400:kworker.0 00000100:00080000:3.0:1789126964.909263:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789126964.909269:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789126964.909272:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789126964.909735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126964.909740:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276797568:0@lo:400:kworker.0 00000100:00100000:1.0:1789126964.909750:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276797184:0@lo:400:kworker.0 00000100:00100000:0.0:1789126964.909768:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276797952:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.909816:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797440 00000100:00100000:2.0:1789126964.909821:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797440 00000100:00100000:2.0:1789126964.909866:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789126964.909874:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276797440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.909989:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276797440:12345-0@lo:400:kworker.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.909996:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789126964.910043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.910313:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797184 00000100:00100000:2.0:1789126964.910318:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797184 00000100:00100000:2.0:1789126964.910350:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1789126964.910359:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126964.910375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126964.910407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:def09dbb-e047-4ff8-a277-077b6777bba2+24:3641:x1876035276797184:12345-0@lo:400:kworker.0 Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126964.910416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276798464:0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.910417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789126964.910452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126964.910469:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276798976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126964.910492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126964.910527:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789126964.910551:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798976 00000100:00100000:0.0:1789126964.910555:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798976 00000100:00100000:1.0:1789126964.910556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276797952 00000100:00100000:1.0:1789126964.910562:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276797952 00000100:00100000:0.0:1789126964.910585:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789126964.910592:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276798976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126964.910607:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789126964.910766:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276798976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.910770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276798464 00000100:00100000:0.0:1789126964.910785:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789126964.910786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276798464 00000100:00100000:2.0:1789126964.910820:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789126964.910827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276797952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.910860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276797952:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.910866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789126964.910880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789126964.910886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276798464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789126964.910911:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276798464:12345-0@lo:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126964.910917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:2.0:1789126964.910958:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789126964.911023:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276797184:0@lo:400:kworker.0 00000100:00100000:0.0:1789126964.912419:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276798976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789126964.912463:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276797952:0@lo:400:kworker.0 00000100:00100000:0.0:1789126964.912599:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276798464:0@lo:400:kworker.0 00000001:00080000:2.0:1789126964.913947:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789126964.913961:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789126964.914087:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789126964.914100:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1789126965.483369:0:14485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789126965.674863:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789126965.739344:0:14482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789126965.739352:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789126965.739464:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789126965.739472:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789126965.991238:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126965.992815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258925952 00000100:00100000:0.0:1789126965.992831:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258925952 00000100:00100000:0.0:1789126965.993012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:0.0:1789126965.993024:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+18:13433:x1876035258925952:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:0.0:1789126965.993298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:13433:x1876035258925952:12345-192.168.203.23@tcp:35:umount.0 Request processed in 272us (2069us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789126965.993307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00080000:2.0:1789126965.993566:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789126965.999637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126966.002250:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258926208 00000100:00100000:1.0:1789126966.002265:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258926208 00000100:00100000:1.0:1789126966.002425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:1.0:1789126966.002436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+19:13433:x1876035258926208:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:1.0:1789126966.002748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:13433:x1876035258926208:12345-192.168.203.23@tcp:35:umount.0 Request processed in 313us (3119us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789126966.002757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:0.0:1789126966.010383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.012640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258926464 00000100:00100000:2.0:1789126966.012692:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258926464 00000100:00100000:2.0:1789126966.012751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1789126966.012762:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212264c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+20:13433:x1876035258926464:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:2.0:1789126966.013060:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212264c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:13433:x1876035258926464:12345-192.168.203.23@tcp:35:umount.0 Request processed in 298us (2685us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789126966.013068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1789126966.024305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.024441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258926720 00000100:00100000:2.0:1789126966.024451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258926720 00000100:00100000:2.0:1789126966.024507:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1789126966.024516:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:13433:x1876035258926720:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:2.0:1789126966.024825:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:13433:x1876035258926720:12345-192.168.203.23@tcp:35:umount.0 Request processed in 308us (528us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789126966.024834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1789126966.031282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.031324:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.031344:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.031420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.031449:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258927104 00000100:00100000:2.0:1789126966.031459:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258927104 00000100:00100000:2.0:1789126966.031518:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:2.0:1789126966.031529:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+7:2390:x1876035258927104:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:2.0:1789126966.031575:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eb028 00000020:00010000:2.0:1789126966.031582:0:8906:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9942118e5800: total 0 00000100:00080000:2.0:1789126966.031587:0:8906:0:(import.c:65:import_set_state_nolock()) ffff9942118e3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789126966.031629:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789126966.031814:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258927104:12345-192.168.203.23@tcp:9:umount.0 Request processed in 287us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126966.031823:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00080000:2.0:1789126966.031844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789126966.031975:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258927232 00000100:00100000:1.0:1789126966.031979:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258927232 00000100:00100000:1.0:1789126966.032016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258927488 00000100:00100000:1.0:1789126966.032019:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258927488 00000100:00100000:1.0:1789126966.032038:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258927360 00000100:00100000:1.0:1789126966.032040:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258927360 00000100:00100000:1.0:1789126966.032055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789126966.032062:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+15:2393:x1876035258927232:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126966.032073:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126966.032103:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588a00/0xa840b4da666ea983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c289 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.032121:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126966.032154:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+14:2393:x1876035258927232:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 91us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126966.032161:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789126966.032178:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1789126966.032184:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+13:2393:x1876035258927488:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126966.032191:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126966.032201:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cac00/0xa840b4da666eacee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c37e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.032211:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126966.032229:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:2393:x1876035258927488:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 45us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126966.032235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1789126966.032247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789126966.032254:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2393:x1876035258927360:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789126966.032261:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789126966.032270:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030800/0xa840b4da666ea944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c24a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.032278:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789126966.032296:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2393:x1876035258927360:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126966.032301:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000020:00010000:3.0:1789126966.032631:0:9514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9942118e5800: total 0 00010000:00010000:3.0:1789126966.032704:0:9514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9942118e5800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789126966.032750:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b03c50a/0xa840b4da666ebab6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c74b expref: 4 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126966.032806:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055115d8b/0xa840b4da666eb3e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c568 expref: 3 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126966.032819:0:9514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9942118e5800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789126966.032832:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126966.032834:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126966.032836:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126966.036477:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126966.036553:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258927616 00000100:00100000:3.0:1789126966.036563:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258927616 00000100:00100000:3.0:1789126966.036640:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1789126966.036679:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258927616:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:3.0:1789126966.036708:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eadb9 00000100:00080000:3.0:1789126966.036716:0:8430:0:(import.c:65:import_set_state_nolock()) ffff994220359800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789126966.036754:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789126966.036922:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+2:2390:x1876035258927616:12345-192.168.203.23@tcp:9:umount.0 Request processed in 272us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126966.036930:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:1.0:1789126966.037230:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789126966.037597:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789126966.045643:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.045823:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258928640 00000100:00100000:2.0:1789126966.045833:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258928640 00000100:00100000:0.0:1789126966.046067:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 258 00000100:00100000:0.0:1789126966.046090:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+22:2390:x1876035258928640:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:0.0:1789126966.046122:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea952 00000020:00010000:0.0:1789126966.046137:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9941031ea800: total 0 00000100:00080000:0.0:1789126966.046141:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9941031e8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789126966.046173:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789126966.046332:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7cbe914d-2346-44a4-9fd5-22d31c7628a2+21:2390:x1876035258928640:12345-192.168.203.23@tcp:39:umount.0 Request processed in 255us (697us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789126966.046340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 258 00000020:00010000:1.0:1789126966.046842:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9941031ea800: total 0 00010000:00010000:1.0:1789126966.046903:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9941031ea800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789126966.046938:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126966.046954:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126966.046963:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666eb997 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c6fe expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.046983:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126966.046986:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789126966.046990:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216d600/0xa840b4da666eb3d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c561 expref: 19 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047002:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126966.047004:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789126966.047007:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148fa00/0xa840b4da666eb08a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c481 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047020:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99423648f400) 00010000:00010000:1.0:1789126966.047022:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789126966.047026:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148f000/0xa840b4da666ead34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c393 expref: 17 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047043:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126966.047045:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789126966.047048:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216c800/0xa840b4da666eb46c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c58b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047060:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103eaaf00) 00010000:00010000:1.0:1789126966.047063:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789126966.047067:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666ead18 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c38c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047110:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126966.047112:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126966.047116:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396200/0xa840b4da666eba77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c736 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047127:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126966.047130:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789126966.047133:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666eb2c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c51b expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047143:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff994103ea9600) 00010000:00010000:1.0:1789126966.047145:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789126966.047147:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397000/0xa840b4da666eb759 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c664 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047161:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:1.0:1789126966.047163:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789126966.047166:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99424216ca00/0xa840b4da666eb450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c584 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047178:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff994102e04600) 00010000:00010000:1.0:1789126966.047180:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789126966.047183:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ebaa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c744 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047198:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff994236490300) 00010000:00010000:1.0:1789126966.047201:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789126966.047212:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99420148ea00/0xa840b4da666ead8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c3a8 expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047229:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff994103ea9d00) 00010000:00010000:1.0:1789126966.047232:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789126966.047235:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666eb3a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c553 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126966.047246:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9941031ea800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789126966.047260:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126966.047262:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126966.047264:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126966.055710:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126966.055848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258928768 00000100:00100000:2.0:1789126966.055858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258928768 00000100:00080000:0.0:1789126966.055970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789126966.056051:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 259 00000100:00100000:2.0:1789126966.056063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+5:2390:x1876035258928768:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:2.0:1789126966.056210:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea959 00000100:00080000:2.0:1789126966.056230:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9941041ae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789126966.056954:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789126966.057155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7cbe914d-2346-44a4-9fd5-22d31c7628a2+3:2390:x1876035258928768:12345-192.168.203.23@tcp:39:umount.0 Request processed in 1092us (1452us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789126966.057165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 259 00010000:00010000:3.0:1789126966.060262:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126966.699315:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126966.955637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276799104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789126966.955731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126966.955921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799104 00000100:00100000:0.0:1789126966.955928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799104 00000100:00100000:0.0:1789126966.955985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789126966.955994:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276799104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789126966.956030:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789126966.956097:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276799104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126966.956104:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789126966.956319:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276799104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789126967.466909:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276799232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789126967.466929:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276799360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789126967.466999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126967.467076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126967.467147:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799360 00000100:00100000:2.0:1789126967.467155:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799360 00000100:00100000:2.0:1789126967.467228:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799232 00000100:00100000:2.0:1789126967.467231:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799232 00000100:00100000:2.0:1789126967.467251:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789126967.467259:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276799360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789126967.467300:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126967.467345:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276799360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126967.467354:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789126967.467371:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789126967.467378:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276799232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789126967.467388:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789126967.467414:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276799232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126967.467420:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789126967.467568:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276799360:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789126967.468095:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126967.468123:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276799232:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789126967.723009:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126967.868740:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126967.868792:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126967.868836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789126967.868983:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258928896 00000100:00100000:0.0:1789126967.869008:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258928896 00000100:00100000:0.0:1789126967.869073:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929152 00000100:00100000:0.0:1789126967.869077:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929152 00000100:00100000:0.0:1789126967.869094:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929024 00000100:00100000:0.0:1789126967.869096:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929024 00000100:00100000:0.0:1789126967.869112:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789126967.869121:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+12:2394:x1876035258928896:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126967.869135:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126967.869155:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f800/0xa840b4da666eaa55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c29e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126967.869172:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126967.869221:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+11:2394:x1876035258928896:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 101us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126967.869229:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789126967.869247:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789126967.869253:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+10:2394:x1876035258929152:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126967.869259:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126967.869268:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166b400/0xa840b4da666eace7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c377 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126967.869277:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126967.869293:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+9:2394:x1876035258929152:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126967.869298:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789126967.869308:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1789126967.869313:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+8:2394:x1876035258929024:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789126967.869330:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126967.869338:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca400/0xa840b4da666eaa5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c2cf expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126967.869360:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126967.869375:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c860d42f-307d-4b4b-a338-6aeff2da97ec+7:2394:x1876035258929024:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 62us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126967.869381:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1789126967.876150:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789126967.876274:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929408 00000100:00100000:3.0:1789126967.876283:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929408 00000100:00100000:3.0:1789126967.876345:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 260 00000100:00100000:3.0:1789126967.876354:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55f22eda-f51b-4ffa-ab32-c741beec7900+6:2390:x1876035258929408:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1789126967.876389:0:15722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eaa6a 00000020:00010000:3.0:1789126967.876396:0:15722:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994229775000: total 0 00000100:00080000:3.0:1789126967.876401:0:15722:0:(import.c:65:import_set_state_nolock()) ffff994229776000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789126967.876431:0:15722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1789126967.876562:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2390:x1876035258929408:12345-192.168.203.23@tcp:39:umount.0 Request processed in 209us (419us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789126967.876570:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 260 00000020:00010000:2.0:1789126967.876853:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994229775000: total 0 00010000:00010000:2.0:1789126967.876903:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994229775000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789126967.876937:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994236492100) 00010000:00010000:2.0:1789126967.876940:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789126967.876948:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3200/0xa840b4da666ebac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c752 expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126967.876968:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994229775000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789126967.876978:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126967.876979:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126967.876981:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789126967.877024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789126967.891991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789126967.892086:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929536 00000100:00100000:2.0:1789126967.892096:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929536 00000100:00100000:2.0:1789126967.892180:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 261 00000100:00100000:2.0:1789126967.892192:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+5:2390:x1876035258929536:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:2.0:1789126967.892236:0:9524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666eaa71 00000100:00080000:2.0:1789126967.892246:0:9524:0:(import.c:65:import_set_state_nolock()) ffff994229775800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789126967.892290:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789126967.892430:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f22eda-f51b-4ffa-ab32-c741beec7900+3:2390:x1876035258929536:12345-192.168.203.23@tcp:39:umount.0 Request processed in 241us (448us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789126967.892438:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 261 00000100:00080000:1.0:1789126967.892615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789126967.892722:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126967.935187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789126967.935298:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929792 00000100:00100000:1.0:1789126967.935310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929792 00000100:00100000:1.0:1789126967.935382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 452 00000100:00100000:1.0:1789126967.935393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+7:2390:x1876035258929792:12345-192.168.203.23@tcp:251:umount.0 00000020:00000080:1.0:1789126967.935439:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea92f 00000020:00010000:1.0:1789126967.935448:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9941032b4800: total 0 00000100:00080000:1.0:1789126967.935453:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789126967.935587:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c860d42f-307d-4b4b-a338-6aeff2da97ec+3:2390:x1876035258929792:12345-192.168.203.23@tcp:251:umount.0 Request processed in 195us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126967.935966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 452 00000020:00010000:3.0:1789126967.936830:0:9514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9941032b4800: total 0 00010000:00010000:3.0:1789126967.936836:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126967.936886:0:9514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9941032b4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789126967.936924:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ea98a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c290 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126967.936940:0:9514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9941032b4800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789126967.936950:0:9514:0:(genops.c:885:class_export_put()) final put ffff9941032b4800/c860d42f-307d-4b4b-a338-6aeff2da97ec 00010000:00010000:3.0:1789126967.936968:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126967.936971:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126967.936972:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789126967.937017:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b4800/c860d42f-307d-4b4b-a338-6aeff2da97ec for MGS 00000020:00000080:2.0:1789126967.937056:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941032b3800 for MGS 00000100:00100000:2.0:1789126968.490906:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789126968.490927:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276799488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789126968.490991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126968.491045:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799488 00000100:00100000:2.0:1789126968.491051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799488 00000100:00100000:2.0:1789126968.491090:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789126968.491098:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276799488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789126968.491130:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789126968.491176:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276799488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126968.491183:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789126968.491251:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276799488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789126968.747197:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789126969.471974:0:15888:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789126969.485891:0:15888:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789126969.485951:0:15888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.485966:0:15888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.485974:0:15888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.485980:0:15888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486014:0:15888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789126969.486019:0:15888:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789126969.486050:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126969.486056:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486063:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cae00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126969.486066:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486075:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126969.486083:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126969.486089:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789126969.486091:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789126969.486093:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789126969.486127:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486134:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126969.486167:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486174:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ea9e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9ec expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.486187:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.486194:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.486196:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126969.486205:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789126969.486224:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276799616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126969.486285:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789126969.486340:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789126969.486344:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789126969.486349:0:15888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789126969.486360:0:15888:0:(import.c:65:import_set_state_nolock()) ffff994238d52000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789126969.486376:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276799744:0@lo:39:umount.0 00000100:00100000:2.0:1789126969.486403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126969.486434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799744 00000100:00100000:2.0:1789126969.486439:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799744 00000100:00100000:2.0:1789126969.486483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789126969.486492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876035276799744:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789126969.486516:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea546 00000100:00080000:2.0:1789126969.486524:0:6514:0:(import.c:65:import_set_state_nolock()) ffff994238d0e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789126969.486601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1876035276799744:12345-0@lo:39:umount.0 Request processed in 109us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789126969.486609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1789126969.486621:0:6514:0:(genops.c:885:class_export_put()) final put ffff994238d0d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789126969.486645:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789126969.486707:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994238d0e800 for lustre-MDT0000 00000100:00080000:2.0:1789126969.486737:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994238d52000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789126969.486758:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276799744:0@lo:39:umount.0 00000100:00080000:2.0:1789126969.486790:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789126969.486792:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789126969.486801:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789126969.486981:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799616 00000100:00100000:0.0:1789126969.487132:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799616 00000100:00100000:0.0:1789126969.487217:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789126969.487228:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:def09dbb-e047-4ff8-a277-077b6777bba2+24:3642:x1876035276799616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.487245:0:13969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126969.487269:0:13969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb000/0xa840b4da666ea9ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9e5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.487287:0:13969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126969.487361:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:def09dbb-e047-4ff8-a277-077b6777bba2+23:3642:x1876035276799616:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.487370:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789126969.487394:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126969.487426:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276799616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789126969.487712:0:15888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487727:0:15888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487736:0:15888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487754:0:15888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487772:0:15888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789126969.487778:0:15888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487785:0:15888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487924:0:15888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487932:0:15888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487949:0:15888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789126969.487968:0:15888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487975:0:15888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487992:0:15888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.487998:0:15888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.488010:0:15888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789126969.488024:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789126969.488029:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.488035:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148e200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126969.488038:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.488046:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126969.488052:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126969.488057:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789126969.488059:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789126969.488110:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.488117:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789126969.489301:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789126969.489368:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276799872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126969.489442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126969.489501:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276799872 00000100:00100000:0.0:1789126969.489508:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276799872 00000100:00100000:0.0:1789126969.489560:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126969.489568:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+23:3641:x1876035276799872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.489582:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126969.489599:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589200/0xa840b4da666ea9fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9f3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.489614:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126969.489795:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:def09dbb-e047-4ff8-a277-077b6777bba2+22:3641:x1876035276799872:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.489803:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789126969.489847:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276799872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.489892:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789126969.489898:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.489907:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126969.489911:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.489919:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126969.489926:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126969.489943:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789126969.489945:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789126969.489948:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789126969.489970:0:9515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.489977:0:9515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789126969.489996:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.490003:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ea8e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.490016:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126969.490181:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.490190:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126969.490193:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490783:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490810:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148e200/0xa840b4da666ea9f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9fa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490821:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.490823:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.490825:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.490842:0:15888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490850:0:15888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490858:0:15888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490865:0:15888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.490883:0:15888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789126969.490888:0:15888:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789126969.490891:0:15888:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789126969.490930:0:15888:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789126969.490935:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789126969.490940:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126969.490945:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789126969.490951:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99422d6bd000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789126969.490957:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff994236580000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789126969.490961:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99422d542800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789126969.490973:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff994238d51000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789126969.490979:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff994229775000 55f22eda-f51b-4ffa-ab32-c741beec7900 192.168.203.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789126969.490984:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9941031ea800 7cbe914d-2346-44a4-9fd5-22d31c7628a2 192.168.203.23@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1789126969.490989:0:15888:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9942290f3490) has exports, disconnecting them 00000020:00080000:2.0:1789126969.490994:0:15888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99422d6bd000), last request at 1789126964 00000020:00000080:2.0:1789126969.491000:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea856 00000100:00080000:2.0:1789126969.491017:0:15888:0:(import.c:65:import_set_state_nolock()) ffff99422d6be800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789126969.491053:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126969.491057:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.491064:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420166bc00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126969.491067:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.491075:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126969.491082:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126969.491087:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789126969.491090:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789126969.491092:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789126969.491113:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.491119:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126969.491140:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.491146:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420166bc00/0xa840b4da666ea4a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea4ac expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126969.491156:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.491158:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126969.491160:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789126969.491174:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99422d6bd000): rc 0 00000020:00000080:2.0:1789126969.491177:0:15888:0:(genops.c:885:class_export_put()) final put ffff99422d6bd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789126969.491189:0:15888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994236580000), last request at 1789126964 00000020:00000080:2.0:1789126969.491193:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea730 00000100:00080000:2.0:1789126969.491199:0:15888:0:(import.c:65:import_set_state_nolock()) ffff9942290bd800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789126969.491204:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126969.491214:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789126969.491216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d6bd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 10000000:01000000:0.0:1789126969.491223:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789126969.491227:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789126969.491229:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789126969.491255:0:9515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789126969.491260:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422d6be800 for lustre-MDT0000 00010000:00010000:0.0:1789126969.491262:0:9515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126969.491276:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126969.491280:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789126969.491288:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994236580000): rc 0 00010000:00010000:0.0:1789126969.491291:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364cb600/0xa840b4da666eacd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eace0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789126969.491292:0:15888:0:(genops.c:885:class_export_put()) final put ffff994236580000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789126969.491305:0:15888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99422d542800), last request at 1789126748 00010000:00010000:0.0:1789126969.491308:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789126969.491309:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea62d 00010000:00010000:0.0:1789126969.491312:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789126969.491316:0:15888:0:(import.c:65:import_set_state_nolock()) ffff99422d545000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789126969.491316:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789126969.491333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994236580000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1789126969.491334:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800000:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789126969.491364:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942290bd800 for lustre-MDT0000 00010000:00010000:2.0:1789126969.491376:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789126969.491384:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99422d542800): rc 0 00000100:00100000:0.0:1789126969.491389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789126969.491390:0:15888:0:(genops.c:885:class_export_put()) final put ffff99422d542800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789126969.491403:0:15888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994238d51000), last request at 1789126748 00000020:00000080:2.0:1789126969.491408:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5f5 00000100:00080000:2.0:1789126969.491421:0:15888:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789126969.491437:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d542800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1789126969.491443:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126969.491452:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126969.491481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789126969.491494:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422d545000 for lustre-MDT0000 00000001:00000004:2.0:1789126969.491513:0:15888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:0.0:1789126969.491516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126969.491524:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276800256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126969.491545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126969.491568:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800000 00000100:00100000:0.0:1789126969.491572:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800000 00000100:00100000:0.0:1789126969.491605:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800128 00000100:00100000:0.0:1789126969.491607:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800128 00000100:00100000:0.0:1789126969.491632:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800256 00000100:00100000:0.0:1789126969.491634:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800256 00000020:00080000:2.0:1789126969.491638:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994238d51000): rc 0 00000004:00000080:2.0:1789126969.491666:0:15888:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb30541a27ae0 00000100:00100000:0.0:1789126969.491672:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126969.491681:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+24:3639:x1876035276800000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.491692:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1789126969.491699:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789126969.491704:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789126969.491711:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588c00/0xa840b4da666ea8f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea8e9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.491724:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126969.491764:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+23:3639:x1876035276800000:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.491771:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789126969.491785:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126969.491791:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+22:3639:x1876035276800128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.491798:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126969.491807:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200031600/0xa840b4da666ea4ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea4a5 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.491815:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126969.491832:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+21:3639:x1876035276800128:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.491837:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789126969.491847:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789126969.491852:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+20:3641:x1876035276800256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789126969.491858:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789126969.491866:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3800/0xa840b4da666eace0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666eacd9 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126969.491873:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789126969.491892:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:def09dbb-e047-4ff8-a277-077b6777bba2+19:3641:x1876035276800256:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.491897:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789126969.491909:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126969.491945:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126969.491952:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789126969.491973:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276800256:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789126969.492502:0:15888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789126969.492520:0:15888:0:(import.c:65:import_set_state_nolock()) ffff9942364be800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789126969.492582:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800384:0@lo:39:umount.0 00010000:00010000:2.0:1789126969.492585:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789126969.492724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789126969.492760:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789126969.492764:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789126969.492778:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789126969.492790:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800384 00000100:00100000:0.0:1789126969.492796:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800384 00000100:00100000:0.0:1789126969.492831:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789126969.492839:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276800384:12345-0@lo:39:umount.0 00000100:00080000:2.0:1789126969.492856:0:15888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:0.0:1789126969.492864:0:7778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea688 00000100:00080000:2.0:1789126969.492869:0:15888:0:(import.c:65:import_set_state_nolock()) ffff99422f9ea000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789126969.492872:0:7778:0:(import.c:65:import_set_state_nolock()) ffff99422d6bb800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789126969.492885:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789126969.492888:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000001:00000004:0.0:1789126969.492894:0:7778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000004:00080000:2.0:1789126969.492901:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789126969.492968:0:15888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789126969.492980:0:15888:0:(import.c:65:import_set_state_nolock()) ffff9941041ab000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789126969.493015:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3638:x1876035276800384:12345-0@lo:39:umount.0 Request processed in 175us (290us total) trans 4294967301 rc 0/0 00000020:00080000:2.0:1789126969.493026:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9942290f3490) has no exports 00000100:00100000:0.0:1789126969.493207:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789126969.493237:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800512:0@lo:9:umount.0 00000100:00100000:0.0:1789126969.493265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126969.493286:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800640:0@lo:9:umount.0 00000100:00100000:3.0:1789126969.493299:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800512 00000100:00100000:3.0:1789126969.493306:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800512 00000100:00100000:0.0:1789126969.493309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789126969.493339:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942364be800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789126969.493345:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800384:0@lo:39:umount.0 00000100:00100000:3.0:1789126969.493356:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800640 00000100:00100000:3.0:1789126969.493360:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800640 00000100:00100000:0.0:1789126969.493369:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789126969.493379:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276800512:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789126969.493393:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000020:00000080:0.0:1789126969.493393:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea7e6 00000100:00100000:3.0:1789126969.493405:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276800640:12345-0@lo:9:umount.0 00000100:00080000:0.0:1789126969.493407:0:8429:0:(import.c:65:import_set_state_nolock()) ffff99422f9c4800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789126969.493423:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea91a 00000100:00080000:3.0:1789126969.493430:0:8906:0:(import.c:65:import_set_state_nolock()) ffff9941041af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789126969.493447:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:3.0:1789126969.493467:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789126969.493559:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3638:x1876035276800512:12345-0@lo:9:umount.0 Request processed in 181us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126969.493569:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1789126969.493596:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126969.493603:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126969.493606:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3638:x1876035276800640:12345-0@lo:9:umount.0 Request processed in 202us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126969.493615:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789126969.493626:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422f9ea000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789126969.493635:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789126969.493721:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789126969.493724:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789126969.493727:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800512:0@lo:9:umount.0 00000100:00080000:0.0:1789126969.493741:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941041ab000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789126969.493759:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789126969.493761:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789126969.493763:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276800640:0@lo:9:umount.0 00000100:00080000:1.0:1789126969.494005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789126969.494010:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1789126969.511612:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9942290f3490) has no exports 00000020:00000080:3.0:1789126969.578021:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea500 00000020:00000080:3.0:1789126969.578037:0:15888:0:(genops.c:885:class_export_put()) final put ffff99423d062800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789126969.578054:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789126969.578204:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d062800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789126969.578272:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789126969.578284:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789126969.578289:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99423d000000) has no exports 00000020:00000080:0.0:1789126969.578641:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea4f9 00000020:00000080:0.0:1789126969.578669:0:15888:0:(genops.c:885:class_export_put()) final put ffff99423d03b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789126969.578727:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789126969.578734:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789126969.578737:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942295aa800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789126969.578739:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff9942295aa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789126969.578759:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789126969.579211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1789126969.770878:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126970.027008:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276800768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126970.027086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126970.027220:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800768 00000100:00100000:0.0:1789126970.027229:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800768 00000100:00100000:0.0:1789126970.027312:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789126970.027325:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276800768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789126970.027358:0:8431:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789126970.027436:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276800768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126970.027449:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789126970.027493:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800896:0@lo:400:kworker.0 00000100:00100000:3.0:1789126970.027507:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276801024:0@lo:400:kworker.0 00000100:00080000:1.0:1789126970.027636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789126970.027673:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276801280:0@lo:400:kworker.0 00000100:00100000:3.0:1789126970.028568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126970.028617:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276801536:0@lo:400:kworker.0 00000100:00100000:3.0:1789126970.028679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789126970.028751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801024 00000100:00100000:3.0:1789126970.028759:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801024 00000100:00100000:3.0:1789126970.028801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789126970.028809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876035276801024:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789126970.028819:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789126970.028865:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876035276801024:12345-0@lo:400:kworker.0 Request processed in 55us (302us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789126970.028873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789126970.028898:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801536 00000100:00100000:3.0:1789126970.028917:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801536 00000100:00100000:3.0:1789126970.028964:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789126970.028971:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276801536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789126970.029013:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276801536:12345-0@lo:400:kworker.0 Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789126970.029020:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789126970.029062:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789126970.029067:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789126970.029072:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789126970.029686:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276801152:0@lo:400:kworker.0 00000100:00100000:2.0:1789126970.029774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126970.029816:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276801664:0@lo:400:kworker.0 00000100:00100000:2.0:1789126970.029849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126970.029901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801152 00000100:00100000:2.0:1789126970.029907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801152 00000100:00100000:2.0:1789126970.029940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801664 00000100:00100000:2.0:1789126970.029943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801664 00000100:00100000:2.0:1789126970.029962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789126970.029968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276801152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789126970.029976:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789126970.030013:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276801152:12345-0@lo:400:kworker.0 Request processed in 43us (238us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126970.030019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789126970.030034:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789126970.030038:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276801664:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789126970.030041:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789126970.030062:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276801664:12345-0@lo:400:kworker.0 Request processed in 23us (212us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126970.030067:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789126970.030100:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789126970.030105:0:3641:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789126970.030109:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789126970.030113:0:3641:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789126970.030117:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1789126970.030123:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff994220b43800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789126970.030146:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422fb8f840 x1876035276801920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126970.030167:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276801152:0@lo:400:kworker.0 00000100:00080000:2.0:1789126970.030183:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789126970.030186:0:3641:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789126970.030189:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789126970.030191:0:3641:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789126970.030194:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:2.0:1789126970.030197:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102d0d000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789126970.030206:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422fb8cf00 x1876035276802048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126970.030216:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276801664:0@lo:400:kworker.0 00000100:00100000:2.0:1789126970.030237:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276801920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789126970.030259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126970.030272:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276802048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789126970.030286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126970.030320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801920 00000100:00100000:2.0:1789126970.030323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801920 00000100:00100000:2.0:1789126970.030337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802048 00000100:00100000:2.0:1789126970.030338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802048 00000100:00100000:2.0:1789126970.030347:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789126970.030352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276801920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789126970.030365:0:6514:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789126970.031383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126970.031426:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276801408:0@lo:400:kworker.0 00000100:00100000:0.0:1789126970.031461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126970.031491:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276800896 00000100:00100000:0.0:1789126970.031496:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276800896 00000100:00100000:0.0:1789126970.031590:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789126970.031598:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+19:3639:x1876035276800896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126970.031637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:def09dbb-e047-4ff8-a277-077b6777bba2+19:3639:x1876035276800896:12345-0@lo:400:kworker.0 Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126970.031644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789126970.031693:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276800896:0@lo:400:kworker.0 00000100:00100000:0.0:1789126970.031731:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801408 00000100:00100000:0.0:1789126970.031734:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801408 00000100:00100000:1.0:1789126970.032023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126970.032038:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276801792:0@lo:400:kworker.0 00000100:00100000:1.0:1789126970.032056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126970.032080:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276800768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789126970.032108:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801280 00000100:00100000:1.0:1789126970.032111:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801280 00000100:00100000:1.0:1789126970.032124:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276801792 00000100:00100000:1.0:1789126970.032126:0:9524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276801792 00000100:00100000:1.0:1789126970.032141:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789126970.032147:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276801792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789126970.032179:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276801792:12345-0@lo:400:kworker.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126970.032184:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789126970.032196:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789126970.032200:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276802048:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789126970.032210:0:9524:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789126970.032235:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276802048:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (1948us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789126970.032252:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789126970.032262:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789126970.032266:0:9524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1876035276801280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789126970.032271:0:9524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789126970.032353:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789126970.032360:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276801408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126970.032391:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276801408:12345-0@lo:400:kworker.0 Request processed in 32us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126970.032397:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:0.0:1789126970.032422:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104808780 x1876035276801408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126970.032432:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276801408:0@lo:400:kworker.0 00000100:00080000:0.0:1789126970.032471:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789126970.032476:0:3642:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789126970.032479:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789126970.032483:0:3642:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789126970.032487:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 195 00000100:00080000:0.0:1789126970.032492:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994102d0a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126970.032510:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99420a88d2c0 x1876035276802176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126970.032634:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276801280:0@lo:400:kworker.0 00010000:00080000:0.0:1789126970.032664:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410480ad00 x1876035276801792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126970.032673:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276801792:0@lo:400:kworker.0 00000100:00100000:0.0:1789126970.032698:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276802176:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789126970.032723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789126970.032837:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126970.032842:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126970.032845:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276802048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789126970.032868:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802176 00000100:00100000:0.0:1789126970.032872:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802176 00000100:00100000:0.0:1789126970.032889:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789126970.032893:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276802176:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789126970.032902:0:15722:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789126970.032931:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276802176:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36us (207us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789126970.032946:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1789126970.032970:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126970.032973:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126970.032976:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276802176:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1789126970.033013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789126970.033018:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789126970.033098:0:9524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1876035276801280:12345-0@lo:400:kworker.0 Request processed in 22us (268us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789126970.033105:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789126970.056344:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789126970.056357:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 173 00000100:00080000:3.0:1789126970.056375:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9942290b9800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789126970.056540:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410480ad00 x1876035276802304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789126970.056565:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276801024:0@lo:400:kworker.0 00000100:00100000:3.0:1789126970.056611:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276801536:0@lo:400:kworker.0 00000100:00100000:1.0:1789126970.057005:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276802304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789126970.057100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126970.057171:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802304 00000100:00100000:1.0:1789126970.057176:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802304 00000100:00100000:1.0:1789126970.057209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789126970.057216:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276802304:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789126970.057232:0:6518:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789126970.057272:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276802304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (172us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789126970.057279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1789126970.057324:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789126970.057329:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789126970.057332:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276802304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789126970.060230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276801920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29867us (29961us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789126970.060245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789126970.060335:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789126970.060341:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789126970.060345:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276801920:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1789126970.795687:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789126971.567706:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789126971.567720:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000001:00100000:1.0:1789126971.567792:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789126971.567798:0:6491:0:(genops.c:885:class_export_put()) final put ffff994238d51000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789126971.567952:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00080000:1.0:1789126971.567959:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789126971.567962:0:6491:0:(genops.c:885:class_export_put()) final put ffff994229775000/55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00100000:1.0:1789126971.567968:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000001:00080000:1.0:1789126971.567976:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789126971.567986:0:6491:0:(genops.c:885:class_export_put()) final put ffff9941031ea800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:1.0:1789126971.568022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d51000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789126971.568193:0:7443:0:(genops.c:885:class_export_put()) final put ffff99422d6bb000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789126971.568206:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00080000:2.0:1789126971.568213:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789126971.568215:0:7443:0:(genops.c:885:class_export_put()) final put ffff994229772000/55f22eda-f51b-4ffa-ab32-c741beec7900 00000001:00100000:2.0:1789126971.568219:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000001:00080000:2.0:1789126971.568223:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789126971.568225:0:7443:0:(genops.c:885:class_export_put()) final put ffff9941041ad000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:1.0:1789126971.568237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994229775000/55f22eda-f51b-4ffa-ab32-c741beec7900 for lustre-MDT0000 00000020:00000080:1.0:1789126971.568274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031ea800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-MDT0000 00000020:00000080:1.0:1789126971.568301:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422d6b9800 for lustre-MDT0000 00000020:00000080:1.0:1789126971.568315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d6bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789126971.568355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994229772000/55f22eda-f51b-4ffa-ab32-c741beec7900 for lustre-MDT0001 00000020:00000080:1.0:1789126971.568378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941041ad000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-MDT0001 00000020:00000080:1.0:1789126971.568400:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994229776000 for lustre-MDT0000 00000020:00000080:1.0:1789126971.568405:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941031e8000 for lustre-MDT0000 00000020:00000080:1.0:1789126971.568410:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422d6bb800 for lustre-MDT0001 00000020:00000080:1.0:1789126971.568414:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994229775800 for lustre-MDT0001 00000020:00000080:1.0:1789126971.568418:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941041ae000 for lustre-MDT0001 00000001:00100000:2.0:1789126971.569149:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789126971.569154:0:8422:0:(genops.c:885:class_export_put()) final put ffff99422f9c3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789126971.569176:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:2.0:1789126971.569179:0:8422:0:(genops.c:885:class_export_put()) final put ffff99422035d000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:1.0:1789126971.569390:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422f9c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789126971.571476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422035d000/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-OST0000 00000020:00000080:1.0:1789126971.571518:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422f9c4800 for lustre-OST0000 00000020:00000080:1.0:1789126971.571523:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994220359800 for lustre-OST0000 00000001:00100000:0.0:1789126971.571645:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789126971.571678:0:9505:0:(genops.c:885:class_export_put()) final put ffff9941041ad800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789126971.571697:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:0.0:1789126971.571700:0:9505:0:(genops.c:885:class_export_put()) final put ffff9942118e5800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 00000020:00000080:3.0:1789126971.571931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9941041ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789126971.571975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9942118e5800/7cbe914d-2346-44a4-9fd5-22d31c7628a2 for lustre-OST0001 00000020:00000080:3.0:1789126971.571995:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941041af800 for lustre-OST0001 00000020:00000080:3.0:1789126971.571999:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942118e3000 for lustre-OST0001 00000020:01000000:0.0:1789126971.627119:0:15888:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994104055cc0 - data ffff994231748510/ffff9941032d7c00 00000020:01000000:0.0:1789126971.627278:0:15888:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff99421106af60 - data ffff994231582d80/ffff99423d2d3c00 00000001:00000004:0.0:1789126971.637551:0:15888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789126971.690320:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789126971.690329:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789126971.690343:0:15888:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9941030770c0 x1876035276800384/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789126979 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126971.690368:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789126971.692768:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789126971.692774:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789126971.692792:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789126971.692795:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789126971.693295:0:8904:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789126971.693300:0:8904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789126971.693310:0:8904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789126971.694008:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789126971.694012:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1789126971.694031:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789126971.694034:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789126971.695412:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789126971.695418:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1789126971.695429:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789126971.697870:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea4c8 00000020:00000080:1.0:1789126971.697881:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942404e0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789126971.698925:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9942404e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789126971.707005:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea4dd 00000020:00000080:2.0:1789126971.707021:0:15888:0:(genops.c:885:class_export_put()) final put ffff994238d57000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789126971.707990:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789126971.707999:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126971.708007:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789126971.708012:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9942290f1a48) has no exports 00000004:01000000:2.0:1789126971.708339:0:15888:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789126971.708350:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea913 00000020:00000080:2.0:1789126971.708357:0:15888:0:(genops.c:885:class_export_put()) final put ffff9941041aa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789126971.712313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d57000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789126971.712345:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789126971.712357:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126971.712374:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789126971.712379:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff994103ecb490) has no exports 00000020:00000080:2.0:1789126971.712389:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea90c 00000020:00000080:2.0:1789126971.712398:0:15888:0:(genops.c:885:class_export_put()) final put ffff9941041ac000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789126971.713437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941041aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1789126971.713886:0:15888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789126971.713890:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789126971.713894:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1789126971.713899:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789126971.713902:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789126971.717331:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941041ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789126971.717396:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126971.717412:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789126971.717422:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea7d1 00000020:00000080:2.0:1789126971.717431:0:15888:0:(genops.c:885:class_export_put()) final put ffff994102656800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789126971.717538:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941041ab000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789126971.717551:0:37:0:(genops.c:885:class_export_put()) final put ffff994236698800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789126971.717553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994236698800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789126971.717704:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789126971.717819:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789126971.717824:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126971.717831:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789126971.717835:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff994102eb9a48) has no exports 00000020:00000080:2.0:1789126971.717841:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea7ca 00000020:00000080:2.0:1789126971.717846:0:15888:0:(genops.c:885:class_export_put()) final put ffff99422f9ee000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789126971.718175:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102656800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789126971.718183:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422f9ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789126971.719068:0:15888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789126971.719141:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789126971.719145:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789126971.719151:0:15888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789126971.719153:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789126971.719232:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126971.719243:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789126971.719257:0:15888:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789126971.719263:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea681 00000020:00000080:2.0:1789126971.719270:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942404e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789126971.719297:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422f9ea000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789126971.719303:0:36:0:(genops.c:885:class_export_put()) final put ffff9942364ba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789126971.719306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9942364ba000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789126971.719311:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789126971.719489:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789126971.719498:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126971.719504:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789126971.719508:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff994212210000) has no exports 00000020:00000080:2.0:1789126971.719514:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea67a 00000020:00000080:2.0:1789126971.719518:0:15888:0:(genops.c:885:class_export_put()) final put ffff99423d063800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789126971.719534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9942404e3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:3.0:1789126971.720849:0:15888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789126971.720856:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789126971.720859:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789126971.720866:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789126971.720990:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d063800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789126971.723435:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942364be800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789126971.723504:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126971.723518:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789126971.723523:0:15888:0:(genops.c:885:class_export_put()) final put ffff994220b44000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789126971.723527:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff994220b44000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789126971.723539:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789126971.723681:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126971.723691:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789126971.723695:0:15888:0:(genops.c:885:class_export_put()) final put ffff994220b40800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789126971.723698:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff994220b40800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789126971.723704:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789126971.723923:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea4e4 00000020:00000080:3.0:1789126971.724174:0:15888:0:(genops.c:885:class_export_put()) final put ffff994238d53000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789126971.724192:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789126971.724197:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126971.724203:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789126971.724207:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff994238d4ced8) has no exports 00000020:00000080:3.0:1789126971.724229:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126971.724233:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789126971.724285:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea4eb 00000020:00000080:3.0:1789126971.724290:0:15888:0:(genops.c:885:class_export_put()) final put ffff994238d54000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789126971.724323:0:15888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994212236800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789126971.724327:0:15888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994212236800 3 00000020:01000004:3.0:1789126971.724330:0:15888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994212236800 from lustre-MDT0000 00000020:00000080:3.0:1789126971.724350:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126971.724355:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789126971.724365:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942404e1000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789126971.724368:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff9942404e1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789126971.724375:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789126971.724409:0:15888:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789126971.724414:0:15888:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789126971.724417:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789126971.724419:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126971.724422:0:15888:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789126971.724435:0:15888:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff994202f1f800 def09dbb-e047-4ff8-a277-077b6777bba2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789126971.724440:0:15888:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9942290f4ed8) has exports, disconnecting them 00000020:00080000:3.0:1789126971.724445:0:15888:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff994202f1f800), last request at 1789126729 00000020:00000080:3.0:1789126971.724459:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea489 00000020:00010000:3.0:1789126971.724463:0:15888:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994202f1f800: total 2 00000100:00080000:3.0:1789126971.724468:0:15888:0:(import.c:65:import_set_state_nolock()) ffff994202f19800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789126971.724494:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994202f1f800): rc 0 00000020:00080000:3.0:1789126971.724498:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9942290f4ed8) has no exports 00000100:00100000:3.0:1789126971.724565:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9942080e2800:6507] 2 exiting: rc = 0 00000100:00100000:3.0:1789126971.725022:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9942346e1e00:6505] 0 exiting: rc = 1 00000020:00010000:3.0:1789126971.725234:0:9515:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994202f1f800: total 2 00010000:00010000:3.0:1789126971.725269:0:9515:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994202f1f800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789126971.725304:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030400/0xa840b4da666ea8aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea8a3 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.725327:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2400/0xa840b4da666ea9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea99f expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.725349:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994200030000/0xa840b4da666eacd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666eaccb expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726008:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588800/0xa840b4da666eaa08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666eaa01 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726025:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ee00/0xa840b4da666ea998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea991 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726039:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb400/0xa840b4da666ea9c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9bb expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726051:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca800/0xa840b4da666eacaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666eaca8 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726063:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588000/0xa840b4da666ea9b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9ad expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726087:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589600/0xa840b4da666ea9d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9c9 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726104:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166ac00/0xa840b4da666eacbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666eacb6 expref: 5 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726136:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420166a200/0xa840b4da666ea585 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea57e expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726146:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cba00/0xa840b4da666ea9de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea9d7 expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726172:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99424216da00/0xa840b4da666ea593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ea58c expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126971.726183:0:9515:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994202f1f800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789126971.726215:0:9515:0:(genops.c:885:class_export_put()) final put ffff994202f1f800/def09dbb-e047-4ff8-a277-077b6777bba2 00000020:00000080:1.0:1789126971.726355:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d53000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:3.0:1789126971.726872:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126971.726875:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126971.726877:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789126971.726954:0:36:0:(genops.c:885:class_export_put()) final put ffff994220b42800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789126971.726957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994220b42800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789126971.726963:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789126971.727032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789126971.727038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994202f1f800/def09dbb-e047-4ff8-a277-077b6777bba2 for MGS 00000020:00000080:1.0:1789126971.727206:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994202f19800 for MGS 00000100:00100000:1.0:1789126971.727243:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9942080e2600:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1789126971.727440:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727450:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727457:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727463:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727469:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727481:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727489:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727495:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727501:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727507:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727513:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727519:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727524:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727530:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727535:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727541:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727546:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727552:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727560:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727565:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727571:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727945:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727957:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727965:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727987:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727993:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.727998:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728004:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728009:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728015:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728020:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728024:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728029:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728034:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728040:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728045:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728057:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728063:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728135:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728146:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728152:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728156:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728161:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728167:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728173:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728178:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728183:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728189:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728194:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728199:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728203:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728208:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728213:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728217:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728222:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728227:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728232:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728237:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728242:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728255:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728261:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728265:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728271:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126971.728277:0:15888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789126971.729766:0:15888:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff99423647a9c0 - data ffff99423173aaf8/ffff994103145400 00000020:01000000:1.0:1789126971.729890:0:15888:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994210b6c060 - data ffff99423153fa20/ffff994212256000 00000020:00000080:1.0:1789126971.730541:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea46d 00000020:00000080:1.0:1789126971.730551:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942405ea000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789126971.730588:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9942405ea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789126971.730602:0:15888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994212236800 from MGS, refs=2 00000020:01000004:1.0:1789126971.730606:0:15888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994212236800 2 00000020:01000004:1.0:1789126971.730609:0:15888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994212236800 from MGS 00000020:00000080:1.0:1789126971.730629:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789126971.730636:0:15888:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789126971.730638:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942405ee000/MGS 00000020:00000080:1.0:1789126971.730640:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff9942405ee000/MGS for MGS 00000020:01000000:1.0:1789126971.730663:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789126971.730744:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789126971.730748:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789126971.730754:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789126971.730760:0:15888:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff994238d55800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789126971.730766:0:15888:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff994238d48000) has exports, disconnecting them 00000020:00080000:1.0:1789126971.730771:0:15888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff994238d55800), last request at 1789126729 00000020:00000080:1.0:1789126971.730775:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea538 00000020:00080000:1.0:1789126971.730860:0:15888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994238d55800): rc 0 00000020:00000080:1.0:1789126971.730866:0:15888:0:(genops.c:885:class_export_put()) final put ffff994238d55800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789126971.730891:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d55800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789126971.736744:0:15888:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789126971.736752:0:15888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789126971.736756:0:15888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789126971.736763:0:15888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789126971.736928:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126971.736937:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789126971.736944:0:15888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994212236800 1 00000020:00000080:3.0:1789126971.736951:0:15888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea45f 00000020:00000080:3.0:1789126971.736959:0:15888:0:(genops.c:885:class_export_put()) final put ffff9942405ef000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789126971.736964:0:15888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789126971.736969:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126971.736972:0:15888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789126971.736976:0:15888:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff994212211a48) has no exports 00000020:00000080:1.0:1789126971.742303:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994238d52000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789126971.742320:0:37:0:(genops.c:885:class_export_put()) final put ffff994238d54800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789126971.742324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d54800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789126971.742335:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789126971.742515:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9942405ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789126971.820104:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789126971.834059:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126971.834081:0:15888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789126971.834087:0:15888:0:(genops.c:885:class_export_put()) final put ffff994212231800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789126971.834091:0:15888:0:(genops.c:844:class_export_destroy()) destroying export ffff994212231800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789126971.834102:0:15888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789126971.834224:0:15888:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994212237800 00000020:02000400:2.0:1789126971.834282:0:15888:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1789126972.586790:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126972.586875:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276802432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789126972.587159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126972.590076:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802432 00000100:00100000:1.0:1789126972.590092:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802432 00000100:00100000:1.0:1789126972.590168:0:11368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789126972.590179:0:11368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276802432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789126972.590215:0:11368:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789126972.590314:0:11368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276802432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126972.590322:0:11368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789126972.590390:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276802432:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789126972.591005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789126972.842768:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126973.866967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126974.891807:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126975.150877:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276802560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789126975.150961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126975.151184:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802560 00000100:00100000:1.0:1789126975.151192:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802560 00000100:00100000:1.0:1789126975.151254:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789126975.151264:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276802560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789126975.151292:0:8432:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789126975.151339:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276802560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126975.151346:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789126975.151401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789126975.151437:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276802560:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789126975.157000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789126975.157008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789126975.157012:0:37:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789126975.157021:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1789126975.157026:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789126975.157032:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9942290b9800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126975.157056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ec4f00 x1876035276802816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789126975.157081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789126975.157084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789126975.157086:0:37:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789126975.157090:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1789126975.157092:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789126975.157096:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff994220b43800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126975.157110:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ec52c0 x1876035276802944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789126975.157118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789126975.157121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789126975.157122:0:37:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789126975.157125:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1789126975.157128:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789126975.157131:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994102d0a000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126975.157140:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ec6d00 x1876035276803072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789126975.157169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789126975.157172:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789126975.157174:0:37:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789126975.157177:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1789126975.157179:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789126975.157182:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102d0d000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789126975.157193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ec6940 x1876035276803456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789126975.157236:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276803200:0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.157300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.157346:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789126975.157352:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276802688:0@lo:400:kworker.0 00000400:00000100:0.0:1789126975.157370:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276802688 offset 0 length 224: 4 00000100:00100000:0.0:1789126975.157393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276802816:0@lo:38:kworker.0 00000100:00100000:0.0:1789126975.157419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.157437:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276802944:0@lo:38:kworker.0 00000100:00100000:0.0:1789126975.157459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.157474:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276803072:0@lo:38:kworker.0 00000100:00100000:0.0:1789126975.157495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.157509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276803456:0@lo:38:kworker.0 00000100:00100000:0.0:1789126975.157529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.157556:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803200 00000100:00100000:0.0:1789126975.157562:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803200 00000100:00100000:0.0:1789126975.157607:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802944 00000100:00100000:0.0:1789126975.157610:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802944 00000100:00100000:0.0:1789126975.157619:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803072 00000100:00100000:0.0:1789126975.157620:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803072 00000100:00100000:0.0:1789126975.157627:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803456 00000100:00100000:0.0:1789126975.157643:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803456 00000100:00100000:0.0:1789126975.157682:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789126975.157691:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276803200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.157749:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276803200:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126975.157765:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789126975.157784:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789126975.157787:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276802944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789126975.157806:0:15722:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789126975.157840:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276802944:12345-0@lo:38:kworker.0 Request processed in 50us (380us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789126975.157847:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789126975.157859:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789126975.157862:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276803072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789126975.157872:0:15722:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789126975.157894:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276803072:12345-0@lo:38:kworker.0 Request processed in 30us (398us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789126975.157900:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789126975.157911:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789126975.157914:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276803456:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789126975.157923:0:15722:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789126975.157945:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876035276803456:12345-0@lo:38:kworker.0 Request processed in 29us (415us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789126975.157951:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789126975.157968:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276802816 00000100:00100000:0.0:1789126975.157972:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276802816 00000100:00100000:0.0:1789126975.157992:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789126975.157997:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876035276802816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789126975.158007:0:7778:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789126975.158040:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876035276802816:12345-0@lo:38:kworker.0 Request processed in 41us (621us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789126975.158046:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:0.0:1789126975.158090:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff994219ec4000 x1876035276803200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126975.158103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276803200:0@lo:400:kworker.0 00000100:00080000:0.0:1789126975.158132:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126975.158137:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126975.158141:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276802816:0@lo:38:kworker.0 00000100:00080000:0.0:1789126975.158149:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126975.158152:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126975.158155:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276802944:0@lo:38:kworker.0 00000100:00080000:0.0:1789126975.158162:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126975.158165:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126975.158168:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276803072:0@lo:38:kworker.0 00000100:00080000:0.0:1789126975.158176:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789126975.158179:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789126975.158182:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276803456:0@lo:38:kworker.0 00000100:00100000:0.0:1789126975.158209:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276803328:0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.158237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.158260:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789126975.158267:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276803584:0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.158288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789126975.158324:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803328 00000100:00100000:0.0:1789126975.158328:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803328 00000100:00100000:0.0:1789126975.158358:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789126975.158365:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276803328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.158403:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276803328:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126975.158410:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789126975.158425:0:15722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803584 00000100:00100000:0.0:1789126975.158428:0:15722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803584 00000100:00100000:0.0:1789126975.158449:0:15722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789126975.158456:0:15722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276803584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.158483:0:15722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276803584:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789126975.158489:0:15722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00080000:0.0:1789126975.158518:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff994219ec5e00 x1876035276803584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126975.158528:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276803584:0@lo:400:kworker.0 00000100:00100000:0.0:1789126975.158537:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276803328:0@lo:400:kworker.0 00000100:00080000:0.0:1789126975.158553:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789126975.158557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:1.0:1789126975.271261:0:16089:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789126975.286274:0:16089:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789126975.286326:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.286340:0:16089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.286349:0:16089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.286355:0:16089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.286377:0:16089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789126975.286383:0:16089:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789126975.286408:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789126975.286423:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789126975.286430:0:16089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789126975.286436:0:16089:0:(import.c:65:import_set_state_nolock()) ffff994220b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789126975.286441:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789126975.286442:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789126975.286446:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789126975.287010:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789126975.287018:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.287027:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789126975.287031:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.287040:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789126975.287048:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126975.287061:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789126975.287064:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789126975.287066:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789126975.287100:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.287107:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789126975.287161:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276803712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126975.287229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789126975.288149:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288162:0:16089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288169:0:16089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288176:0:16089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288196:0:16089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789126975.288201:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288207:0:16089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288214:0:16089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288221:0:16089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288243:0:16089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789126975.288249:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288255:0:16089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288261:0:16089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288267:0:16089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288278:0:16089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789126975.288283:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288288:0:16089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288295:0:16089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288301:0:16089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126975.288307:0:16089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789126975.288310:0:16089:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789126975.288338:0:16089:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789126975.288342:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789126975.288345:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789126975.288350:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789126975.288355:0:16089:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff994236582800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789126975.288361:0:16089:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff994102d0d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789126975.288366:0:16089:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99423d003490) has exports, disconnecting them 00000020:00080000:1.0:1789126975.288370:0:16089:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff994236582800), last request at 1789126975 00000020:00000080:1.0:1789126975.288377:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea86b 00000100:00080000:1.0:1789126975.288392:0:16089:0:(import.c:65:import_set_state_nolock()) ffff99422f9ed800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789126975.288433:0:16089:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994236582800): rc 0 00000020:00000080:1.0:1789126975.288435:0:16089:0:(genops.c:885:class_export_put()) final put ffff994236582800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789126975.288443:0:16089:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff994102d0d800), last request at 1789126975 00000020:00000080:1.0:1789126975.288446:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea745 00000100:00080000:1.0:1789126975.288450:0:16089:0:(import.c:65:import_set_state_nolock()) ffff994102d0f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789126975.288454:0:16089:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994102d0d800): rc 0 00000020:00000080:1.0:1789126975.288456:0:16089:0:(genops.c:885:class_export_put()) final put ffff994102d0d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789126975.288463:0:16089:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb3054188bae0 00000100:00080000:1.0:1789126975.288477:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789126975.288481:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789126975.289394:0:16089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789126975.289402:0:16089:0:(import.c:65:import_set_state_nolock()) ffff9942290b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1789126975.289497:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.289506:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588200/0xa840b4da666ea9c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.289522:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789126975.289526:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.289532:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789126975.289536:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.289545:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789126975.289552:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789126975.289558:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789126975.289561:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1789126975.289563:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1789126975.289601:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.289607:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789126975.289768:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803712 00000100:00100000:0.0:1789126975.289775:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803712 00000100:00100000:0.0:1789126975.289815:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789126975.289822:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1876035276803712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789126975.289827:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789126975 with bad export cookie 12123889046995772553 00000100:00100000:2.0:1789126975.291062:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789126975.291079:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276803840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126975.291155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789126975.291216:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789126975.291223:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291231:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126975.291235:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291243:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126975.291249:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126975.291266:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789126975.291269:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789126975.291271:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789126975.291299:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291306:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126975.291325:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291332:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ea8a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea8aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291350:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789126975.291354:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291360:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126975.291363:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291370:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126975.291376:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126975.291381:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789126975.291383:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789126975.291384:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789126975.291405:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291411:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126975.291417:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291422:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666eaccb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666eacd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291430:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789126975.291434:0:9514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291438:0:9514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99424216c200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789126975.291441:0:9514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291446:0:9514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789126975.291452:0:9514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789126975.291456:0:9514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789126975.291458:0:9514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789126975.291460:0:9514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789126975.291471:0:9514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291476:0:9514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789126975.291486:0:9514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291498:0:9514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99424216c200/0xa840b4da666ea58c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea593 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789126975.291510:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126975.291512:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789126975.291513:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126975.291527:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803840 00000100:00100000:2.0:1789126975.291533:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803840 00000100:00100000:2.0:1789126975.291562:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126975.291569:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994203d67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1876035276803840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789126975.291575:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789126975 with bad export cookie 12123889046995772553 00000100:00100000:2.0:1789126975.291618:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994203d67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1876035276803840:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (461us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126975.291626:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789126975.291666:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276803968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126975.291692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126975.291864:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789126975.291877:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276804224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789126975.292043:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.292051:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ea9d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ea9de expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126975.292062:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126975.292063:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126975.292065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126975.292072:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126975.292178:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276804096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126975.292293:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276803968 00000100:00100000:2.0:1789126975.292297:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276803968 00000100:00100000:1.0:1789126975.292302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789126975.292316:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276804224 00000100:00100000:2.0:1789126975.292319:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276804224 00000100:00100000:2.0:1789126975.292330:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789126975.292334:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876035276803968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789126975.292339:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789126975 with bad export cookie 12123889046995772553 00000100:00100000:2.0:1789126975.292369:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876035276803968:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (676us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126975.292375:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789126975.292380:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789126975.292383:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789126975.292394:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789126975.292396:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789126975.292400:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876035276804224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789126975.292404:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789126975 with bad export cookie 12123889046995772553 00000100:00100000:2.0:1789126975.292431:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876035276804224:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (129us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126975.292437:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789126975.292465:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789126975.292467:0:16089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789126975.292470:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789126975.292473:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789126975.292479:0:16089:0:(import.c:65:import_set_state_nolock()) ffff994102d1a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789126975.292524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789126975.292553:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789126975.292570:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789126975.292573:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789126975.292580:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789126975.292674:0:16089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789126975.292691:0:16089:0:(import.c:65:import_set_state_nolock()) ffff9941032b6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789126975.292726:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99423d003490) has no exports 00000100:00100000:1.0:1789126975.292757:0:13969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276804096 00000100:00100000:1.0:1789126975.292762:0:13969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276804096 00000100:00100000:1.0:1789126975.292783:0:13969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789126975.292788:0:13969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3640:x1876035276804096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789126975.292792:0:13969:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789126975 with bad export cookie 12123889046995772553 00000100:00100000:1.0:1789126975.292825:0:13969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3640:x1876035276804096:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (300us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789126975.292831:0:13969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:00000080:1.0:1789126975.292897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994236582800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789126975.292939:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d0d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789126975.292959:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422f9ed800 for lustre-MDT0001 00000020:00000080:1.0:1789126975.292963:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102d0f800 for lustre-MDT0001 00010000:00010000:1.0:1789126975.292971:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126975.293020:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276804352:0@lo:9:umount.0 00000100:00100000:1.0:1789126975.293048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126975.293063:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276804480:0@lo:9:umount.0 00000100:00100000:1.0:1789126975.293078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789126975.293268:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276804352 00000100:00100000:1.0:1789126975.293272:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276804352 00000100:00100000:1.0:1789126975.293295:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276804480 00000100:00100000:1.0:1789126975.293302:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276804480 00000100:00100000:1.0:1789126975.293318:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126975.293323:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876035276804352:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789126975.293341:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea792 00000100:00080000:1.0:1789126975.293349:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9942364be000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789126975.293380:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789126975.293513:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1876035276804352:12345-0@lo:9:umount.0 Request processed in 189us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126975.293519:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789126975.293528:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789126975.293533:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876035276804480:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789126975.293542:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea8db 00000100:00080000:1.0:1789126975.293547:0:8428:0:(import.c:65:import_set_state_nolock()) ffff99410407a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789126975.293563:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789126975.293630:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1876035276804480:12345-0@lo:9:umount.0 Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789126975.293636:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789126975.293801:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d1a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789126975.293811:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789126975.293813:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789126975.293817:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276804352:0@lo:9:umount.0 00000100:00080000:1.0:1789126975.293830:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789126975.293839:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789126975.293841:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789126975.293843:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276804480:0@lo:9:umount.0 00010000:00010000:1.0:1789126975.314969:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789126975.315026:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789126975.320123:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.123@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789126975.320129:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789126975.320136:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99420a88d2c0 x1876035276802688/t0(0) o400->MGC192.168.203.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126975.320151:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941048092c0 x1876035276803712/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126975.320160:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104808f00 x1876035276803840/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126975.320169:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422fb8c780 x1876035276803968/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126975.320177:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422fb8cf00 x1876035276804224/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126975.320184:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422fb8f840 x1876035276804096/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789126991 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789126975.320232:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789126975.320235:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789126975.320237:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789126975.320242:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789126975.320247:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:2.0:1789126975.320270:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9942405eb000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789126975.320389:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501a940 x1876035276804608/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126975.320427:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276804608:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789126975.320475:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276804608 offset 0 length 520: 4 00000100:00100000:2.0:1789126975.320537:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276802688:0@lo:400:kworker.0 00000100:00100000:2.0:1789126975.320556:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:def09dbb-e047-4ff8-a277-077b6777bba2:3642:1876035276804224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789126975.320700:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:def09dbb-e047-4ff8-a277-077b6777bba2:3640:1876035276804096:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789126975.320810:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9942405eb000 already not connected (conn 2, was 1): CONNECTING 00000100:00080000:1.0:1789126975.320828:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9942405eb000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1789126975.320844:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:def09dbb-e047-4ff8-a277-077b6777bba2:3639:1876035276803968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789126975.321250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789126975.321262:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276803712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789126975.321276:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:def09dbb-e047-4ff8-a277-077b6777bba2:3641:1876035276803840:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1789126975.330768:0:6498:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876035276803712 offset 224 length 224: 4 00000100:00100000:2.0:1789126975.330795:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1876035276803712:12345-0@lo:103:ldlm_bl.0 Request processed in 40972us (43565us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789126975.330808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:1.0:1789126975.347920:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99423d003490) has no exports 00000020:01000000:2.0:1789126975.450598:0:16089:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994103ce9480 - data ffff99423167d5e8/ffff99410411d400 00000020:01000000:2.0:1789126975.450898:0:16089:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff99422d671540 - data ffff99423162b948/ffff99422d6a0400 00000001:00000004:2.0:1789126975.466927:0:16089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789126975.533217:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789126975.533238:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789126975.533246:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789126975.542876:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789126975.542883:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789126975.542902:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789126975.542904:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789126975.546951:0:8900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789126975.546958:0:8900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789126975.546969:0:8900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789126975.549010:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789126975.549017:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789126975.549074:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789126975.549077:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789126975.559186:0:9976:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789126975.559193:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789126975.559205:0:9976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789126975.560951:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5af 00000020:00000080:3.0:1789126975.560962:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422ccaa000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789126975.568175:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5c4 00000020:00000080:3.0:1789126975.568189:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422ccac800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789126975.568196:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789126975.568201:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126975.568208:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789126975.568212:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff994238d49a48) has no exports 00000004:01000000:3.0:1789126975.568378:0:16089:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789126975.568386:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea8cd 00000020:00000080:3.0:1789126975.568391:0:16089:0:(genops.c:885:class_export_put()) final put ffff9941031e8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789126975.568395:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789126975.568398:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126975.568405:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789126975.568408:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9942366b9a48) has no exports 00000020:00000080:3.0:1789126975.568523:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea8c6 00000020:00000080:3.0:1789126975.568529:0:16089:0:(genops.c:885:class_export_put()) final put ffff9941032b7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789126975.568743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccaa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789126975.568892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccac800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789126975.568898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031e8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789126975.568905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789126975.569331:0:16089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789126975.569336:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789126975.569340:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789126975.569346:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789126975.569349:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789126975.569432:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126975.569442:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789126975.569462:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea78b 00000020:00000080:3.0:1789126975.569468:0:16089:0:(genops.c:885:class_export_put()) final put ffff994102d1f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789126975.569605:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941032b6800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789126975.569622:0:36:0:(genops.c:885:class_export_put()) final put ffff994236585800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789126975.569625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994236585800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789126975.569631:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789126975.570146:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789126975.570152:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126975.570160:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789126975.570164:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9942366b8000) has no exports 00000020:00000080:3.0:1789126975.570169:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea784 00000020:00000080:3.0:1789126975.570174:0:16089:0:(genops.c:885:class_export_put()) final put ffff994102d1d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789126975.570234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d1f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789126975.570763:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d1d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789126975.571286:0:16089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789126975.571290:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789126975.571294:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789126975.571299:0:16089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789126975.571302:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789126975.571372:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126975.571380:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789126975.571393:0:16089:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789126975.571409:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5e7 00000020:00000080:3.0:1789126975.571559:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422d6bf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789126975.571588:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102d1a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789126975.571596:0:36:0:(genops.c:885:class_export_put()) final put ffff994102d19000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789126975.571599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d19000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789126975.571605:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789126975.572019:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789126975.572025:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126975.572031:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789126975.572035:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99422d561a48) has no exports 00000020:00000080:3.0:1789126975.572041:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5e0 00000020:00000080:3.0:1789126975.572046:0:16089:0:(genops.c:885:class_export_put()) final put ffff9942290be800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789126975.572069:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d6bf800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789126975.576618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9942290be800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789126975.582317:0:16089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789126975.582325:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789126975.582329:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789126975.582338:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789126975.582397:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942290b9800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789126975.582402:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789126975.582415:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126975.582421:0:16089:0:(genops.c:885:class_export_put()) final put ffff9942290bb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789126975.582425:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff9942290bb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789126975.582446:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126975.582607:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789126975.582611:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126975.582614:0:16089:0:(genops.c:885:class_export_put()) final put ffff994220b40000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789126975.582617:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff994220b40000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789126975.582620:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789126975.582771:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5cb 00000020:00000080:0.0:1789126975.582778:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422ccab800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789126975.582794:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789126975.582798:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789126975.582802:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789126975.582806:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff99423d004ed8) has no exports 00000020:00000080:0.0:1789126975.582829:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789126975.582832:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789126975.582835:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea5d2 00000020:00000080:0.0:1789126975.582839:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422ccaf000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789126975.582846:0:16089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99423d256000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789126975.582849:0:16089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99423d256000 2 00000020:01000004:0.0:1789126975.582852:0:16089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99423d256000 from lustre-MDT0001 00000020:00000080:0.0:1789126975.582870:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789126975.582873:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789126975.582875:0:16089:0:(genops.c:885:class_export_put()) final put ffff99422ccae000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789126975.582877:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccae000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789126975.582883:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789126975.582908:0:16089:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789126975.582912:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789126975.582914:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789126975.582917:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789126975.582923:0:16089:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff994238d0b800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789126975.582928:0:16089:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff994212214ed8) has exports, disconnecting them 00000020:00000080:1.0:1789126975.582931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccab800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00080000:0.0:1789126975.582935:0:16089:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff994238d0b800), last request at 1789126748 00000020:00000080:1.0:1789126975.582938:0:36:0:(genops.c:885:class_export_put()) final put ffff99422cca9800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789126975.582941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422cca9800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789126975.582950:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea626 00000020:01000000:1.0:1789126975.582951:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00080000:0.0:1789126975.582963:0:16089:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994238d0b800): rc 0 00000020:00000080:0.0:1789126975.582967:0:16089:0:(genops.c:885:class_export_put()) final put ffff994238d0b800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789126975.583186:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccaf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789126975.583193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0b800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789126975.586758:0:16089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789126975.586767:0:16089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789126975.586771:0:16089:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789126975.586778:0:16089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789126975.586810:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994220b43800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789126975.586994:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789126975.587003:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789126975.587018:0:16089:0:(genops.c:885:class_export_put()) final put ffff994238d0d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789126975.587022:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789126975.587028:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789126975.587095:0:16089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99423d256000 1 00000020:00000080:1.0:1789126975.587101:0:16089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea562 00000020:00000080:1.0:1789126975.587107:0:16089:0:(genops.c:885:class_export_put()) final put ffff9942290b9000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789126975.587116:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789126975.587124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9942290b9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789126975.587133:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789126975.587139:0:16089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789126975.587142:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99423d001a48) has no exports 00000020:00000080:2.0:1789126975.770367:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126975.770380:0:16089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789126975.770386:0:16089:0:(genops.c:885:class_export_put()) final put ffff99423d256800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789126975.770390:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d256800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789126975.770402:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789126975.770517:0:16089:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99423d257800 00000020:01000000:2.0:1789126975.770535:0:16089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789126975.770540:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126975.770544:0:16089:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789126975.770548:0:16089:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff994212213490) has no exports 00000100:00100000:0.0:1789126975.774292:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff994229682200:6512] 0 exiting: rc = 1 00000100:00100000:0.0:1789126975.774417:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff994229683000:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1789126975.774543:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff994229682800:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1789126975.774742:0:9524:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff994103ebe800:9524] 3 exiting: rc = 0 00000100:00100000:1.0:1789126975.775371:0:15722:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff994103eb4a00:15722] 4 exiting: rc = 0 00000100:00100000:2.0:1789126975.775916:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775924:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775930:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775935:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775941:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775947:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775963:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775971:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775976:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775982:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775989:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.775995:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776000:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776005:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776011:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776016:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776021:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776027:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776032:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776039:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776044:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776050:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776056:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776062:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776067:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776073:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776079:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776084:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776090:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776095:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776100:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776104:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776110:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776116:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776121:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776139:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776144:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776149:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776154:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776174:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776181:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776187:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776193:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776200:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776205:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776209:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776214:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776219:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776225:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776230:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776235:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776240:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776244:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776248:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776254:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776259:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776264:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776269:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776274:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776280:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776285:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776289:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776294:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.776299:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.779469:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff994229683800:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1789126975.779585:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99421384f200:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1789126975.779907:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779916:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779922:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779930:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779937:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779942:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779963:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779970:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779976:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779982:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779987:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779993:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.779999:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780005:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780010:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780014:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780019:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780024:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780030:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780036:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780041:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780046:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780052:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780057:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780062:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780068:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780072:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780078:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780084:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780089:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780095:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780099:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780104:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780109:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780114:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780119:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780124:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780129:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780134:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780139:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780145:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780157:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780163:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780168:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780174:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780179:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780184:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780189:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780195:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780200:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780205:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780210:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780216:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780222:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780228:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780233:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780238:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780243:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780248:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780253:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780258:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780263:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780269:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780274:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.780711:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff994229097000:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1789126975.780847:0:7778:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff99422d77c400:7778] 2 exiting: rc = 0 00000100:00100000:1.0:1789126975.781047:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99421384ea00:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1789126975.781204:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781213:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781228:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781234:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781240:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781245:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781251:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781256:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781261:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781266:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781272:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781287:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781292:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781297:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781314:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781322:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781327:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781333:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781339:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781344:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781350:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781356:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781361:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781366:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781372:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781378:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781397:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781404:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781410:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781416:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781421:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781427:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781433:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781439:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781445:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781450:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781456:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781462:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781480:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781487:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781492:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781498:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781503:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781509:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781515:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781521:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781534:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781540:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781546:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781551:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781572:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781580:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781585:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781591:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781597:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781603:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781610:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781616:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781621:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781626:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781631:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781637:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.781642:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.782081:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789126975.793369:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff994213c81c00:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1789126975.793610:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff994213c80600:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1789126975.794114:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794122:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794127:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794133:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794138:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794143:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794149:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794154:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794158:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794163:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794167:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794173:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794178:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794182:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794188:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794193:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794198:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794203:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794207:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794212:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794217:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794221:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794226:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794231:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794251:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794256:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794261:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794266:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794271:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794276:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794281:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794286:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794291:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794296:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794302:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794307:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794312:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794317:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794322:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794327:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794332:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794337:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794342:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794347:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794351:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794356:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794361:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794365:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794370:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794375:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794380:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794385:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794390:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794395:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794401:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794406:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794411:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794416:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794421:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794432:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794437:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794442:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794448:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.794453:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795015:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9942122e6c00:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1789126975.795133:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9942122e7c00:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1789126975.795220:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795226:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795232:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795237:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795242:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795247:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795253:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795258:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795264:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795269:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795274:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795278:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795283:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795287:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795292:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795297:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795313:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795317:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795322:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795327:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795332:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795337:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795342:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795347:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795352:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795359:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795364:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795368:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795373:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795378:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795382:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795387:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795393:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795397:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795402:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795408:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795413:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795418:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795424:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795428:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795433:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795438:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795443:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795448:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795454:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795458:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795463:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795469:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795473:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795477:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795482:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795495:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795499:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795503:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795508:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795512:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795517:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795522:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795527:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795532:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795537:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795542:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795546:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.795551:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789126975.796173:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9942122e6e00:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1789126975.796417:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9942122e7600:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1789126975.796522:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796528:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796533:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796539:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796544:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796549:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796555:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796560:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796564:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796570:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796575:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796580:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796585:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796589:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796594:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796599:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796604:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796609:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796613:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796618:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796623:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796627:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.796643:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797134:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797142:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797147:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797152:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797158:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797163:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797169:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797174:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797179:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797184:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797189:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797194:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797200:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797204:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797208:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797214:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797219:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797224:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797229:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797235:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797239:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797244:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797249:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797255:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797261:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797266:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797270:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797276:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797280:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797285:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797290:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797295:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797301:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797306:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797320:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797325:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797330:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797336:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797340:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797345:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.797350:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789126975.798495:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9942122e7400:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1789126975.799180:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9942122e6200:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1789126975.799445:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9942122e6400:6527] 2 exiting: rc = 0 00000100:00100000:2.0:1789126975.799985:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.799993:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.799998:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800003:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800009:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800015:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800020:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800025:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800029:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800035:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800040:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800046:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800052:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800057:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800063:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800067:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800072:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800077:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800083:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800088:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800110:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800116:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800122:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800128:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800132:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800137:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800143:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800148:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800165:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800170:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800176:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800180:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800185:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800190:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800195:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800201:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800206:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800211:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800216:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800221:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800227:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800231:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800236:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800242:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800262:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800268:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800273:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800279:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800285:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800290:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800296:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800301:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800305:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800310:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800315:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800320:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800325:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800329:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800334:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800339:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800345:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800349:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800354:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789126975.800373:0:16089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789126975.804624:0:16089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126975.804638:0:16089:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789126975.804644:0:16089:0:(genops.c:885:class_export_put()) final put ffff9942404e3000/MDS_uuid 00000020:00000080:2.0:1789126975.805035:0:16089:0:(genops.c:844:class_export_destroy()) destroying export ffff9942404e3000/MDS_uuid for MDS 00000020:01000000:2.0:1789126975.805042:0:16089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789126975.805230:0:16089:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789126975.918455:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126976.939920:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126977.962932:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126978.987722:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789126978.996253:0:16290:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789126979.012935:0:16290:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789126979.012989:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126979.013004:0:16290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126979.013012:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126979.013138:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126979.013213:0:16290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789126979.013218:0:16290:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789126979.013248:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789126979.013251:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789126979.013257:0:16290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789126979.013262:0:16290:0:(import.c:65:import_set_state_nolock()) ffff994102d0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789126979.013267:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789126979.013269:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789126979.013272:0:16290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789126979.014976:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789126979.014984:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789126979.015006:0:16290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789126979.015267:0:16290:0:(import.c:65:import_set_state_nolock()) ffff994236581800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789126979.015459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276804736:0@lo:39:umount.0 00000400:00000100:2.0:1789126979.015517:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276804736 offset 0 length 224: 4 00010000:00010000:0.0:1789126979.016322:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789126979.016332:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126979.016343:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126979.016347:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126979.016356:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789126979.016365:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126979.016371:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789126979.016374:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789126979.016376:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789126979.016396:0:9515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:0.0:1789126979.016412:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126979.016419:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588e00/0xa840b4da666ea9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126979.016431:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126979.016433:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126979.016435:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126980.010982:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789126980.266884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789126980.266896:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789126980.266899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789126980.266903:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789126980.266907:0:37:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789126980.266917:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1789126980.266923:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789126980.266932:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102d0d000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789126980.267002:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941043e5e00 x1876035276804864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789126980.267080:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276804864:0@lo:38:kworker.0 00000400:00000100:2.0:1789126980.267135:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276804864 offset 0 length 520: 4 00000100:00100000:3.0:1789126980.267350:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276804992:0@lo:400:kworker.0 00000400:00000100:3.0:1789126980.267377:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276804992 offset 0 length 224: 4 00000001:00100000:3.0:1789126980.780285:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789126980.780294:0:8422:0:(genops.c:885:class_export_put()) final put ffff9942364bd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789126980.780351:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9942364bd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789126980.780397:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942364be000 for lustre-OST0000 00000001:00100000:2.0:1789126980.782293:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789126980.782301:0:9505:0:(genops.c:885:class_export_put()) final put ffff99410407d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789126980.782395:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99410407d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789126980.782525:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99410407a800 for lustre-OST0001 00010000:00010000:0.0:1789126981.036118:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126982.058888:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126983.082878:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126984.107935:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126985.130863:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789126985.388177:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789126975/real 1789126975] req@ffff99410501a940 x1876035276804608/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789126985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789126985.388214:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410501a940 x1876035276804608/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789126985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789126985.388234:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789126985.388258:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789126985.388262:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276804608:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1789126985.388374:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789126985.388379:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789126985.388382:0:37:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789126985.388386:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1789126985.388391:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789126985.388397:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9942405eb000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789126985.388427:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410480b840 x1876035276805120/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789126985.388448:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789126985.388451:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789126985.388791:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789126985.388805:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276805248:0@lo:400:kworker.0 00000400:00000100:0.0:1789126985.388854:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276805248 offset 0 length 224: 4 00000100:00100000:2.0:1789126985.388898:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276805120:0@lo:250:kworker.0 00000400:00000100:2.0:1789126985.388924:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276805120 offset 0 length 520: 4 00010000:00010000:0.0:1789126986.154944:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126987.178879:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126988.203497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126989.227036:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789126989.482780:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789126979/real 1789126979] req@ffff9941048092c0 x1876035276804736/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789126989 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126989.482812:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9941048092c0 x1876035276804736/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789126989 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789126989.482830:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994236581800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789126989.482895:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276804736:0@lo:39:umount.0 00000100:00080000:3.0:1789126989.484322:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789126989.484331:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789126989.484339:0:16290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789126989.485325:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485341:0:16290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485366:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485373:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485434:0:16290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789126989.485443:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485450:0:16290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126989.485457:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789126989.485458:0:16290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485471:0:16290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126989.485471:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126989.485493:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789126989.485499:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126989.485509:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789126989.485515:0:16290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789126989.485520:0:16290:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:0.0:1789126989.485540:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789126989.485546:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:3.0:1789126989.485549:0:16290:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:01000000:0.0:1789126989.485550:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789126989.485555:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000000:3.0:1789126989.485557:0:16290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1789126989.485560:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:3.0:1789126989.485564:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1789126989.485568:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789126989.485571:0:16290:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1789126989.485572:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00000020:00080000:3.0:1789126989.485579:0:16290:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99422d563490) has no exports 00010000:00010000:0.0:1789126989.485580:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126989.485582:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbe00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126989.485587:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126989.485603:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126989.485617:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ea9bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9c2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126989.485636:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126989.485680:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789126989.485685:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126989.485688:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789126989.485691:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789126989.485692:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789126989.485696:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789126989.485707:0:9515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:1.0:1789126989.485710:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126989.485718:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364cbe00/0xa840b4da666eacb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666eacbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126989.485731:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126989.485733:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126989.485735:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789126989.485953:0:16290:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99422d563490) has no exports 00000020:01000000:3.0:1789126989.489480:0:16290:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994103ce9c00 - data ffff9942316b1af8/ffff99410411c000 00000020:01000000:2.0:1789126989.489858:0:16290:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994102f6b4e0 - data ffff9942316805e8/ffff994102eb6000 00100000:10000000:2.0:1789126989.500558:0:16290:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789126989.516774:0:16290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea6ff 00000020:00000080:1.0:1789126989.516787:0:16290:0:(genops.c:885:class_export_put()) final put ffff99422d6bc800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789126989.516798:0:16290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994220b43000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789126989.516802:0:16290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994220b43000 2 00000020:01000004:1.0:1789126989.516805:0:16290:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994220b43000 from lustre-OST0000 00000020:00000080:1.0:1789126989.516827:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789126989.516836:0:16290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789126989.516839:0:16290:0:(genops.c:885:class_export_put()) final put ffff994238d0f000/lustre-OST0000_UUID 00000020:00000080:1.0:1789126989.516842:0:16290:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789126989.516849:0:16290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789126989.516899:0:16290:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789126989.516903:0:16290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789126989.516907:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789126989.516911:0:16290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789126989.516917:0:16290:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff994236586800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789126989.516923:0:16290:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99422d564ed8) has exports, disconnecting them 00000020:00080000:1.0:1789126989.516928:0:16290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff994236586800), last request at 1789126770 00000020:00000080:1.0:1789126989.516932:0:16290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea729 00000020:00080000:1.0:1789126989.516940:0:16290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994236586800): rc 0 00000020:00000080:1.0:1789126989.516956:0:16290:0:(genops.c:885:class_export_put()) final put ffff994236586800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789126989.517600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d6bc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789126989.517631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994236586800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789126989.521129:0:16290:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789126989.521138:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789126989.521153:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789126989.521160:0:16290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789126989.521345:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789126989.521353:0:16290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789126989.521360:0:16290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789126989.521365:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789126989.521369:0:16290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789126989.521377:0:16290:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9942290bd000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789126989.521382:0:16290:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff994102eb8000) has exports, disconnecting them 00000020:00080000:2.0:1789126989.521387:0:16290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9942290bd000), last request at 1789126770 00000020:00000080:2.0:1789126989.521390:0:16290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea73e 00000020:00080000:2.0:1789126989.521406:0:16290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9942290bd000): rc 0 00000020:00000080:2.0:1789126989.521412:0:16290:0:(genops.c:885:class_export_put()) final put ffff9942290bd000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789126989.521827:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102d0a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789126989.521835:0:8:0:(genops.c:885:class_export_put()) final put ffff994102d0c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789126989.521838:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d0c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789126989.521844:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789126989.521908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942290bd000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789126989.522698:0:16290:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789126989.522703:0:16290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789126989.522706:0:16290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789126989.522713:0:16290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789126989.522744:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994236581800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789126989.522893:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126989.522900:0:16290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789126989.522904:0:16290:0:(genops.c:885:class_export_put()) final put ffff9942290b8800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789126989.522906:0:16290:0:(genops.c:844:class_export_destroy()) destroying export ffff9942290b8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789126989.522910:0:16290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789126989.522950:0:16290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994220b43000 1 00000020:00000080:3.0:1789126989.522955:0:16290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea6c7 00000020:00000080:3.0:1789126989.522960:0:16290:0:(genops.c:885:class_export_put()) final put ffff99423669b800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789126989.522968:0:16290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789126989.522976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423669b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789126989.522986:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789126989.522991:0:16290:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789126989.522993:0:16290:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9942366bb490) has no exports 00000020:00000080:3.0:1789126989.560973:0:16290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789126989.560986:0:16290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789126989.560991:0:16290:0:(genops.c:885:class_export_put()) final put ffff99422d544000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789126989.560995:0:16290:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d544000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789126989.561005:0:16290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789126989.561127:0:16290:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99422d541800 00000020:02000400:3.0:1789126989.561165:0:16290:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789126990.252557:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789126990.507829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789126990.507844:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789126990.507847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789126990.507851:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789126990.507947:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276805376:0@lo:400:kworker.0 00000400:00000100:3.0:1789126990.508021:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276805376 offset 0 length 224: 4 00010000:00010000:0.0:1789126991.278541:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126992.298807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789126992.315773:0:16492:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789126992.330095:0:16492:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789126992.330188:0:16492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126992.330204:0:16492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126992.330213:0:16492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126992.330221:0:16492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789126992.330268:0:16492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789126992.330275:0:16492:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789126992.330306:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789126992.330322:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941043e5e00 x1876035276804864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127000 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789126992.330340:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789126992.330346:0:16492:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789126992.330352:0:16492:0:(import.c:65:import_set_state_nolock()) ffff994102d0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1789126992.330385:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789126992.330393:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126992.330401:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789126992.330405:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126992.330413:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789126992.330421:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789126992.330427:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789126992.330430:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789126992.330432:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789126992.330447:0:9515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:1.0:1789126992.330451:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126992.330458:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ea991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea998 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789126992.330468:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126992.330470:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126992.330471:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789126992.330618:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789126992.330624:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941043e5e00 x1876035276804864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127000 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126992.330638:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789126992.330642:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1789126992.331312:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276804864:0@lo:38:kworker.0 00000100:00080000:1.0:1789126992.332505:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789126992.332516:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941043e4000 x1876035276804992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789126996 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126992.332542:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941048083c0 x1876035276805248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126992.332564:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104809a40 x1876035276805376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127006 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789126992.332572:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789126992.332577:0:16492:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789126992.332609:0:16492:0:(import.c:65:import_set_state_nolock()) ffff994102d0e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789126992.332644:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276805504:0@lo:39:umount.0 00000400:00000100:3.0:1789126992.332715:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276805504 offset 0 length 224: 4 00000100:00100000:2.0:1789126992.332728:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276805376:0@lo:400:kworker.0 00000100:00100000:2.0:1789126992.332744:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276805248:0@lo:400:kworker.0 00000100:00100000:0.0:1789126992.334891:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276804992:0@lo:400:kworker.0 00010000:00010000:1.0:1789126993.323372:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126994.347167:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126995.375792:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789126995.626941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789126995.626951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789126996.394946:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789126997.425006:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789126998.442920:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789126999.467621:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127000.492699:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127000.556782:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789126985/real 1789126985] req@ffff99410480b840 x1876035276805120/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127000.556815:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410480b840 x1876035276805120/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127000.556836:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127000.556972:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789127000.556978:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276805120:0@lo:250:kworker.0 00000100:00080000:0.0:1789127000.557049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) def09dbb-e047-4ff8-a277-077b6777bba2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127000.557054:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789127000.557057:0:8:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127000.557062:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1789127000.557067:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.123@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789127000.557074:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9942405eb000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127000.557102:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488c780 x1876035276805632/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127000.557214:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276805632:0@lo:250:kworker.0 00000400:00000100:3.0:1789127000.557259:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276805632 offset 0 length 520: 4 00010000:00010000:0.0:1789127001.514926:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127002.538857:0:9514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127002.602932:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789126992/real 1789126992] req@ffff9941043e6d00 x1876035276805504/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127002.603512:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9941043e6d00 x1876035276805504/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127002.603546:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102d0e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789127002.603627:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276805504:0@lo:39:umount.0 00000100:00080000:1.0:1789127002.607205:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789127002.607825:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789127002.607835:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789127002.609804:0:16492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609824:0:16492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609832:0:16492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609858:0:16492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609887:0:16492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127002.609895:0:16492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609903:0:16492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609909:0:16492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.609914:0:16492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.610112:0:16492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789127002.610118:0:16492:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789127002.610142:0:16492:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789127002.610146:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789127002.610151:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127002.610158:0:16492:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789127002.610162:0:16492:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff994102ebb490) has no exports 00000020:00080000:1.0:1789127002.610465:0:16492:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff994102ebb490) has no exports 00010000:00010000:0.0:1789127002.612902:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127002.612914:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.612927:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127002.612945:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.612955:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127002.612963:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127002.613033:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127002.613036:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789127002.613039:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789127002.613124:0:9515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:0.0:1789127002.613128:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613135:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ea99f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea9a6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613149:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127002.613153:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613159:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127002.613162:0:9515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613168:0:9515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127002.613174:0:9515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127002.613186:0:9515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789127002.613188:0:9515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789127002.613189:0:9515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789127002.613197:0:9515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:0.0:1789127002.613199:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613205:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994200031c00/0xa840b4da666eaca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666eacaf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127002.613284:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127002.613286:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127002.613288:0:9515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127002.613856:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789127002.618393:0:16492:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9941040554e0 - data ffff9942317480d8/ffff99422969f000 00000020:01000000:1.0:1789127002.618543:0:16492:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994103018ea0 - data ffff994231700870/ffff994236691000 00100000:10000000:1.0:1789127002.638495:0:16492:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789127002.648591:0:16492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea825 00000020:00000080:1.0:1789127002.648617:0:16492:0:(genops.c:885:class_export_put()) final put ffff9941031ec800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789127002.648769:0:16492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994102d1e800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789127002.648774:0:16492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994102d1e800 2 00000020:01000004:1.0:1789127002.648778:0:16492:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994102d1e800 from lustre-OST0001 00000020:00000080:1.0:1789127002.648805:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127002.648814:0:16492:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789127002.648818:0:16492:0:(genops.c:885:class_export_put()) final put ffff9941031eb000/lustre-OST0001_UUID 00000020:00000080:1.0:1789127002.648822:0:16492:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031eb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789127002.648831:0:16492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789127002.649033:0:16492:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import def09dbb-e047-4ff8-a277-077b6777bba2->MGS 00010000:00010000:1.0:1789127002.649049:0:16492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99424216ce00/0xa840b4da666ea57e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127002.649061:0:16492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99424216ce00/0xa840b4da666ea57e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127002.649067:0:16492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789127002.649070:0:16492:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789127002.649073:0:16492:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789127002.649088:0:16492:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:1.0:1789127002.649091:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99424216ce00/0xa840b4da666ea57e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ea585 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127002.649109:0:16492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127002.649115:0:16492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127002.649121:0:16492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789127002.649123:0:16492:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789127002.649125:0:16492:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789127002.649346:0:16492:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942405eb000 00010000:00010000:1.0:1789127002.649349:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca600/0xa840b4da666eaa01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666eaa08 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789127002.649368:0:16492:0:(import.c:65:import_set_state_nolock()) ffff9942405eb000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789127002.649371:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789127002.649373:0:16492:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789127002.649375:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789127002.649379:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789127002.649389:0:16492:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99410488c780 x1876035276805632/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789127020 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789127002.649617:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789127002.649620:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1789127002.649692:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:def09dbb-e047-4ff8-a277-077b6777bba2:3638:1876035276805632:0@lo:250:kworker.0 10000000:01000000:1.0:1789127002.649946:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789127002.649955:0:16492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea47b 00000020:00000080:1.0:1789127002.649961:0:16492:0:(genops.c:885:class_export_put()) final put ffff9942404e4000/def09dbb-e047-4ff8-a277-077b6777bba2 00000020:01000000:1.0:1789127002.649969:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.123@tcp (flags='') 00000020:00000080:1.0:1789127002.649974:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127002.649979:0:16492:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789127002.649982:0:16492:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9942290f0000) has no exports 10000000:01000000:3.0:1789127002.651683:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1789127002.651988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031ec800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789127002.652007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942404e4000/def09dbb-e047-4ff8-a277-077b6777bba2 for MGC192.168.203.123@tcp 10000000:01000000:3.0:1789127002.652041:0:16492:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.123@tcp: client import never connected 00000100:00080000:3.0:1789127002.652056:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789127002.652059:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789127002.652062:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789127002.652065:0:16492:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789127002.652108:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127002.652115:0:16492:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.123@tcp (uuid def09dbb-e047-4ff8-a277-077b6777bba2) 00000020:01000000:3.0:1789127002.652122:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789127002.652127:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127002.652132:0:16492:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127002.652138:0:16492:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9941031e9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127002.652144:0:16492:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff994102ebced8) has exports, disconnecting them 00000020:00080000:3.0:1789127002.652149:0:16492:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9941031e9800), last request at 1789126788 00000020:00000080:2.0:1789127002.652154:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942405eb000 for MGC192.168.203.123@tcp 00000020:00000080:3.0:1789127002.652155:0:16492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea84f 00000020:00000080:2.0:1789127002.652164:0:8:0:(genops.c:885:class_export_put()) final put ffff9942405e9800/def09dbb-e047-4ff8-a277-077b6777bba2 00000020:00000080:2.0:1789127002.652169:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942405e9800/def09dbb-e047-4ff8-a277-077b6777bba2 for MGC192.168.203.123@tcp 00000020:00080000:3.0:1789127002.652171:0:16492:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941031e9800): rc 0 00000020:00000080:3.0:1789127002.652179:0:16492:0:(genops.c:885:class_export_put()) final put ffff9941031e9800/lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789127002.652180:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.123@tcp (def09dbb-e047-4ff8-a277-077b6777bba2) 00000020:00000080:2.0:1789127002.652851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031e9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789127002.653783:0:16492:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789127002.653788:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127002.653801:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127002.653807:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127002.653957:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102d0d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789127002.654960:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127002.654970:0:16492:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789127002.654976:0:16492:0:(genops.c:885:class_export_put()) final put ffff9941031eb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789127002.654980:0:16492:0:(genops.c:844:class_export_destroy()) destroying export ffff9941031eb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789127002.655101:0:16492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789127002.655161:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789127002.655165:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127002.655170:0:16492:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127002.655178:0:16492:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff994236583000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127002.655184:0:16492:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff994103ec9a48) has exports, disconnecting them 00000020:00080000:2.0:1789127002.655189:0:16492:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff994236583000), last request at 1789126788 00000020:00000080:2.0:1789127002.655193:0:16492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea864 00000020:00080000:2.0:1789127002.655210:0:16492:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994236583000): rc 0 00000020:00000080:2.0:1789127002.655215:0:16492:0:(genops.c:885:class_export_put()) final put ffff994236583000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789127002.655261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994236583000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789127002.668787:0:16492:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789127002.668797:0:16492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789127002.668802:0:16492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789127002.668810:0:16492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127002.668853:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102d0e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789127002.668943:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789127002.669104:0:9514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789127002.669173:0:9515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789127002.705757:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789127002.705911:0:13968:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9942366f6400:13968] 2 exiting: rc = 0 00000100:00100000:1.0:1789127002.706025:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9942118b7e00:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1789127002.722475:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9942118b7000:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1789127002.722561:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.722881:0:7920:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99423d226200:7920] 3 exiting: rc = 0 00000100:00100000:1.0:1789127002.722952:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99420681dc00:6499] 2 exiting: rc = 0 00000100:00100000:3.0:1789127002.723124:0:13969:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff994236751c00:13969] 4 exiting: rc = 0 00000100:00100000:3.0:1789127002.723244:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9942118b7c00:6498] 1 exiting: rc = 0 00000100:00100000:3.0:1789127002.723299:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9942118b6200:6497] 0 exiting: rc = 1 00000100:00100000:1.0:1789127002.723514:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726458:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726472:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726478:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726484:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726489:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726494:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726500:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726506:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726514:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726530:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726535:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726541:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726560:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726567:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726573:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726579:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726585:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726590:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726597:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726602:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726609:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726615:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726620:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726625:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726630:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726635:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726641:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726646:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726686:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726706:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726711:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726716:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726721:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726727:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726735:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726743:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726750:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726758:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726767:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726774:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726779:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726790:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726797:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726804:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726812:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726821:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726827:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726840:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726845:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726850:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726855:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726860:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726865:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726870:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726876:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726881:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726886:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726891:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726895:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726900:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726905:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726909:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.726914:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789127002.727872:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127002.727888:0:16492:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789127002.727990:0:16492:0:(genops.c:885:class_export_put()) final put ffff994236583800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789127002.727995:0:16492:0:(genops.c:844:class_export_destroy()) destroying export ffff994236583800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789127002.728001:0:16492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789127002.728046:0:16492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994102d1e800 1 00000020:00000080:1.0:1789127002.728051:0:16492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ea7f4 00000020:00000080:1.0:1789127002.728057:0:16492:0:(genops.c:885:class_export_put()) final put ffff994102d1d000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789127002.728104:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789127002.728108:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127002.728112:0:16492:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789127002.728116:0:16492:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff99422d560000) has no exports 00000020:00000080:3.0:1789127002.730751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d1d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789127002.763620:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127002.763634:0:16492:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789127002.763640:0:16492:0:(genops.c:885:class_export_put()) final put ffff994102d1e000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789127002.763644:0:16492:0:(genops.c:844:class_export_destroy()) destroying export ffff994102d1e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789127002.763714:0:16492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789127002.764082:0:16492:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994102d19800 00000020:01000000:1.0:1789127002.764101:0:16492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789127002.764105:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127002.764109:0:16492:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789127002.764113:0:16492:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9942366bced8) has no exports 00000020:00000080:1.0:1789127002.764131:0:16492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127002.764134:0:16492:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789127002.764137:0:16492:0:(genops.c:885:class_export_put()) final put ffff99423669c800/OSS_uuid 00000020:00000080:1.0:1789127002.764139:0:16492:0:(genops.c:844:class_export_destroy()) destroying export ffff99423669c800/OSS_uuid for OSS 00000020:01000000:1.0:1789127002.764143:0:16492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789127002.764274:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff994236419600:8428] 0 exiting: rc = 1 00000100:00100000:3.0:1789127002.764294:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff994236418200:8430] 2 exiting: rc = 0 00000100:00100000:2.0:1789127002.764331:0:8906:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff994102d04a00:8906] 3 exiting: rc = 0 00000100:00080000:0.0:1789127002.764429:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789127002.766599:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99422d6b4200:8429] 1 exiting: rc = 0 00000100:00100000:1.0:1789127002.766707:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766720:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766734:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766742:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766748:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766763:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766769:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766773:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766778:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766783:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766789:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766793:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766798:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766802:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766807:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766812:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766817:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766822:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766846:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766852:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766858:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766863:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766867:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766872:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766877:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766882:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766887:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766891:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766897:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766901:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766906:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766911:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766916:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766921:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766926:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766932:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766937:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766942:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766947:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766951:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766964:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766970:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766975:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766980:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766986:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766990:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.766996:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767001:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767006:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767011:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767016:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767021:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767026:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767032:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767038:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767043:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767049:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767054:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767060:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767066:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767070:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767075:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767080:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767091:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.767858:0:11368:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99423d2a9a00:11368] 2 exiting: rc = 0 00000100:00100000:0.0:1789127002.768691:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff994236418000:8432] 1 exiting: rc = 0 00000100:00100000:0.0:1789127002.768784:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff994236419c00:8431] 0 exiting: rc = 1 00000100:00100000:1.0:1789127002.768905:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768913:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768921:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768927:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768932:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768938:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768943:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768947:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768952:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768963:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768980:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768984:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768989:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768993:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.768998:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769002:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769007:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769011:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769016:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769020:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769024:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769029:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769033:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769038:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769044:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769049:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769054:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769058:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769063:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769067:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769071:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769076:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769088:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769096:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769105:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769111:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769118:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769128:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769139:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769147:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769155:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769163:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769168:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769174:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769178:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769191:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769198:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769203:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769209:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769217:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769226:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769235:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769243:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769249:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769254:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769263:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769271:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769275:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769284:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769291:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769296:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769304:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769310:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.769322:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.770306:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99423d1bdc00:8433] 0 exiting: rc = 1 00000100:00100000:2.0:1789127002.770848:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99423641b400:8435] 2 exiting: rc = 0 00000100:00100000:2.0:1789127002.771105:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff994236478200:8434] 1 exiting: rc = 0 00000100:00100000:1.0:1789127002.771305:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771313:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771319:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771325:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771331:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771337:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771342:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771349:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771354:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771360:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771366:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771372:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771378:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771385:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771394:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771411:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771429:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771914:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771927:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771934:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771965:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771973:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771981:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771988:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771993:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.771999:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772004:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772010:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772014:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772020:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772026:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772031:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772037:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772043:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772048:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772053:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772058:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772063:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772070:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772075:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772096:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772102:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772108:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772114:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772119:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772125:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772131:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772137:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772142:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772147:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772176:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772182:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772188:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772194:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772200:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772205:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772211:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772216:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772220:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772225:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772231:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772237:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772243:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127002.772249:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.779142:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99423641a000:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1789127002.782565:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99423641b600:8437] 1 exiting: rc = 0 00000100:00100000:3.0:1789127002.788962:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.788976:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.788984:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.788990:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.788994:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.788999:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789004:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789009:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789015:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789020:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789025:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789029:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789035:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789054:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789061:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789067:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789072:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789077:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789084:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789457:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789686:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789697:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789778:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789789:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789798:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789807:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789828:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789836:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789845:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789856:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789865:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789876:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789885:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789891:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789897:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789902:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789906:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789911:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789916:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789921:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789925:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789930:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789935:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789939:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789944:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789948:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789953:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789958:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789964:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789969:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789974:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789978:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789983:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.789997:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790003:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790008:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790013:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790017:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790021:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790026:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790030:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790050:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790057:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.790062:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792448:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99423643e400:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1789127002.792856:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9942357f3200:8438] 0 exiting: rc = 1 00000100:00100000:3.0:1789127002.792922:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792952:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792963:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792973:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792981:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792987:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792994:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.792999:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793006:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793012:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793018:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793024:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793030:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793062:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793069:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793075:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793087:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793107:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793115:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793125:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793132:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793139:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793150:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793163:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793173:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793226:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793239:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793250:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793261:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793271:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793689:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793965:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793975:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793980:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793986:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793991:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.793996:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794018:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794025:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794031:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794036:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794052:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794059:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794064:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794070:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794075:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794081:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794086:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794102:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794122:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794129:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794134:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794140:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794146:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794152:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794159:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794165:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794171:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794176:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794181:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794187:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794192:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794199:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127002.794225:0:16492:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789127002.818784:0:16492:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789127019.846064:0:17256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789127029.672808:0:17856:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127029.672814:0:17856:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789127029.672816:0:17856:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789127029.672926:0:17856:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9941050e6800 00000020:01000004:0.0:1789127029.672940:0:17856:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789127029.672948:0:17856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789127029.672961:0:17856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff994103ecced8) 00000020:00000080:0.0:1789127029.672974:0:17856:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789127029.748383:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.757681:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789127029.758493:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.764583:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.765595:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.766747:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.767098:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.767822:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.768304:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.768571:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.768852:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.769114:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.769410:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789127029.769633:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.769972:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789127029.772693:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.772992:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.773313:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.773582:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.773882:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.774390:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.774821:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.775085:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.775368:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.775605:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.775891:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789127029.776248:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789127029.776518:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.778183:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.778583:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.778919:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.779141:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.780693:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.780939:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.781114:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.781285:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.781534:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.782034:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.782281:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.782512:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.782844:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.783050:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.783213:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.783413:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.783761:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.784020:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789127029.784181:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789127029.784890:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789127029.785234:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789127029.785493:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789127029.786027:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789127029.786186:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789127029.786380:0:17856:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1789127029.787266:0:17856:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127029.787510:0:17856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789127029.787517:0:17856:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127029.787837:0:17856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebad2 00000020:01000004:2.0:1789127029.787845:0:17856:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789127029.787850:0:17856:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789127029.787856:0:17856:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9941050e6800 from MGS 00000020:01000004:2.0:1789127029.787860:0:17856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789127029.787871:0:17856:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9942366bced8) 00000020:00000080:2.0:1789127029.787880:0:17856:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789127029.787936:0:17856:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9941050e6800 from MGS, refs=2 00080000:01000000:2.0:1789127029.787946:0:17856:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789127029.787950:0:17856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebae0 00000100:00100000:2.0:1789127029.788038:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789127029.788163:0:17856:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789127029.788169:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789127029.788677:0:17856:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789127029.788683:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789127029.789419:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127029.789629:0:17856:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789127029.789634:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789127029.790225:0:17856:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789127029.790232:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789127029.792231:0:17856:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789127029.792253:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789127029.792946:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127029.792949:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127029.792951:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127029.793165:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127029.793167:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127029.793169:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127029.793642:0:17856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789127029.794744:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789127029.802019:0:17856:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789127029.803532:0:17868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789127029.803599:0:17856:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789127029.803635:0:17856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789127029.804968:0:17856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789127029.805737:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127029.805929:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789127029.805937:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789127029.807885:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789127029.807895:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789127029.808368:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789127029.808375:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789127029.810095:0:17856:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789127029.810118:0:17856:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:0.0:1789127029.810120:0:17856:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789127029.810168:0:17856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:0.0:1789127029.810182:0:17856:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (ffff994103ec8000) 00000020:00000080:0.0:1789127029.810208:0:17856:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789127029.810324:0:17856:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941050e4800@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00000100:00080000:2.0:1789127029.810496:0:17873:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1789127029.810513:0:17856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:0.0:1789127029.810530:0:17856:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789127029.811610:0:17874:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789127029.811760:0:17856:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0) 00000020:00000080:1.0:1789127029.811780:0:17856:0:(genops.c:1385:class_connect()) connect: client 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0, cookie 0xa840b4da666ebaee 00000100:00080000:1.0:1789127029.811791:0:17856:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127029.811797:0:17856:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9941050e4800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127029.811880:0:17856:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941043e6580 x1876035276805760/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127029.811956:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276805760:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789127029.812025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127029.812082:0:17856:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS 00000020:01000004:1.0:1789127029.812105:0:17856:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789127029.812109:0:17856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789127029.812121:0:17856:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff994102ebb490) 00000020:00000080:1.0:1789127029.812131:0:17856:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789127029.812367:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276805760 00000100:00100000:2.0:1789127029.812375:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276805760 00000100:00100000:2.0:1789127029.812621:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127029.812630:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1876035276805760:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789127029.812710:0:17870:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1789127029.812733:0:17870:0:(genops.c:1385:class_connect()) connect: client 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0, cookie 0xa840b4da666ebafc 00000100:00080000:2.0:1789127029.812853:0:17870:0:(import.c:65:import_set_state_nolock()) ffff99421226e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127029.813633:0:3638:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00100000:2.0:1789127029.813634:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:3638:x1876035276805760:12345-0@lo:250:mount.lustre.0 Request processed in 999us (1605us total) trans 0 rc 0/0 00000100:00080000:3.0:1789127029.813645:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00100000:2.0:1789127029.813665:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789127029.813679:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789127029.813684:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789127029.813688:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789127029.813691:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789127029.813706:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789127029.813714:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276805760:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789127029.817695:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127029.817923:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789127029.817929:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789127029.820404:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789127029.820416:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789127029.820801:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127029.820808:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789127029.822188:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127029.822431:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789127029.822436:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789127029.824123:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789127029.824130:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789127029.873891:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127029.874079:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789127029.874085:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789127029.875486:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789127029.875495:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789127029.877846:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127029.878021:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127029.878027:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789127029.879059:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789127029.879067:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789127029.884359:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127029.884567:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127029.884734:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789127029.887739:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127029.887752:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789127029.888806:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127029.888979:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127029.888983:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789127029.891267:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127029.891278:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789127029.913067:0:17856:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127029.913484:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127029.913490:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789127029.915338:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127029.915349:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789127029.923178:0:17856:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127029.923199:0:17856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789127029.933108:0:17856:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789127029.933144:0:17856:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789127029.933157:0:17856:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789127029.933378:0:17856:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127029.933413:0:17856:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789127029.933418:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127029.933420:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127029.933422:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127029.933423:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127029.933425:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127029.933426:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127029.933427:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127029.933429:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127029.933430:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127029.933432:0:17856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127029.933434:0:17856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789127029.933436:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127029.933437:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127029.933439:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127029.933440:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127029.933441:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127029.933443:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127029.933444:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127029.933445:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127029.933446:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127029.933447:0:17856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127029.933473:0:17856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789127029.933493:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276805888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127029.933725:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.933772:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127029.933789:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276805888 00000100:00100000:3.0:1789127029.933798:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276805888 00000100:00100000:3.0:1789127029.933846:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127029.933864:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:17856:x1876035276805888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127029.933912:0:17872:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789127029.933915:0:17872:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789127029.933919:0:17872:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789127029.935173:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789127029.935666:0:17872:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789127029.939305:0:17893:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789127029.939312:0:17893:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789127029.939315:0:17893:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789127029.939318:0:17893:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789127029.939580:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789127029.939803:0:17872:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789127029.939815:0:17872:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789127029.941198:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:17856:x1876035276805888:12345-0@lo:253:mount.lustre.0 Request processed in 7329us (7466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127029.941213:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127029.941338:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276805888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127029.941353:0:17856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789127029.941357:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127029.941359:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127029.941360:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127029.941361:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127029.941363:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127029.941364:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127029.941366:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127029.941367:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127029.941368:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127029.941369:0:17856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789127029.941391:0:17856:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9941050e6800 from lustre-MDT0000 10000000:01000000:1.0:1789127029.941421:0:17856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789127029.941423:0:17856:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789127029.941428:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff994103ec8000 10000000:01000000:1.0:1789127029.941432:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127029.941439:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994103ec8000 from 1 10000000:01000000:1.0:1789127029.941442:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789127029.941492:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.941503:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.941513:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127029.941541:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127029.941577:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.941615:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127029.941769:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806016 00000100:00100000:3.0:1789127029.941776:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806016 00000100:00100000:3.0:1789127029.941824:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127029.941835:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:17856:x1876035276806016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127029.941848:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127029.941864:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67800/0xa840b4da666ebb0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebb03 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.941890:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67800/0xa840b4da666ebb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebb03 expref: 6 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.941901:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67800/0xa840b4da666ebb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebb03 expref: 6 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.941910:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67800, rc 0) 00000100:00100000:3.0:1789127029.941953:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+6:17856:x1876035276806016:12345-0@lo:101:mount.lustre.0 Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127029.941960:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127029.942319:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127029.942347:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.942358:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127029.942418:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127029.942446:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.942479:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127029.942544:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806144 00000100:00100000:0.0:1789127029.942549:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806144 00000100:00100000:0.0:1789127029.942577:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127029.942591:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+6:17856:x1876035276806144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127029.942686:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+6:17856:x1876035276806144:12345-0@lo:501:mount.lustre.0 Request processed in 95us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127029.942693:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127029.942767:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127029.942800:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789127029.942818:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.942827:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127029.942835:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9941050e6800 10000000:01000000:1.0:1789127029.942840:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127029.942843:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9941050e6800 10000000:01000000:1.0:1789127029.942846:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789127029.942848:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9941050e6800 from 1 10000000:01000000:1.0:1789127029.942856:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789127029.942872:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.942880:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.942888:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127029.942900:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127029.942925:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.942953:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127029.943511:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806272 00000100:00100000:3.0:1789127029.943517:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806272 00000100:00100000:3.0:1789127029.943562:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127029.943570:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+6:17856:x1876035276806272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127029.943580:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127029.943594:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67a00/0xa840b4da666ebb18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebb11 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.943616:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67a00/0xa840b4da666ebb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebb11 expref: 7 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.943625:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67a00/0xa840b4da666ebb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebb11 expref: 7 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.943633:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67a00, rc 0) 00000100:00100000:3.0:1789127029.943694:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+7:17856:x1876035276806272:12345-0@lo:101:mount.lustre.0 Request processed in 125us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127029.943701:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127029.943826:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127029.943838:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.943847:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127029.943859:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789127029.943911:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.943920:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127029.943926:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789127029.943930:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127029.943939:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9941050e6800 10000000:01000000:1.0:1789127029.943941:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789127029.943944:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789127029.943946:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127029.943962:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.943969:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.943977:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127029.943990:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127029.944014:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.944051:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127029.944131:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806400 00000100:00100000:3.0:1789127029.944146:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806400 00000100:00100000:3.0:1789127029.944183:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127029.944190:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+7:17856:x1876035276806400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127029.944197:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127029.944206:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b66400/0xa840b4da666ebb26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebb1f expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.944221:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b66400/0xa840b4da666ebb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebb1f expref: 8 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.944230:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b66400/0xa840b4da666ebb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebb1f expref: 8 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127029.944248:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66400, rc 0) 00000100:00100000:3.0:1789127029.944287:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+8:17856:x1876035276806400:12345-0@lo:101:mount.lustre.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127029.944346:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127029.944357:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127029.944364:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127029.944411:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127029.944434:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.944463:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127029.944561:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127029.944580:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806528 00000100:00100000:3.0:1789127029.944583:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806528 00000100:00100000:3.0:1789127029.944609:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127029.944616:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+8:17856:x1876035276806528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127029.944772:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17856:x1876035276806528:12345-0@lo:501:mount.lustre.0 Request processed in 156us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127029.945108:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127029.945541:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127029.945569:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127029.945614:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127029.945645:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d26b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127029.945722:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806656 00000100:00100000:0.0:1789127029.945727:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806656 00000100:00100000:0.0:1789127029.945753:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127029.945759:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17856:x1876035276806656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127029.951045:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17856:x1876035276806656:12345-0@lo:503:mount.lustre.0 Request processed in 5276us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127029.951082:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127029.951208:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276806656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127029.952530:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17894:1876035276806784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127029.952591:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127029.952628:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127029.954679:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806784 00000100:00100000:2.0:1789127029.954691:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806784 00000100:00100000:3.0:1789127029.954803:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127029.954816:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17894:x1876035276806784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127029.955475:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17894:x1876035276806784:12345-0@lo:502:llog_process_th.0 Request processed in 661us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127029.955484:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127029.956740:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17894:1876035276806784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127029.956782:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127029.956795:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127029.956797:0:17894:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789127029.956802:0:17894:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789127029.956805:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127029.956821:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff994103ec9a48) 00000020:00000080:0.0:1789127029.956841:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789127029.956847:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789127029.956923:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789127029.956933:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebb34 00000020:00000080:0.0:1789127029.957130:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789127029.957134:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127029.957137:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127029.957139:0:17894:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789127029.957149:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127029.957153:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127029.957154:0:17894:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789127029.957157:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127029.957164:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff994103ecb490) 00000020:00000080:0.0:1789127029.957173:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789127029.957177:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789127029.957179:0:17894:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789127029.957182:0:17894:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789127029.957187:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127029.957590:0:17894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9941050e6800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789127029.957604:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99422d560000) 00000020:00000080:0.0:1789127029.957612:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789127029.957851:0:17894:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789127029.957859:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebb49 00000020:00000080:1.0:1789127029.957961:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789127029.957967:0:17894:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789127029.957972:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa840b4da666ebb50 00080000:01000000:1.0:1789127029.957978:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789127029.957982:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebb57 00010000:00010000:0.0:1789127030.045585:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789127030.046552:0:17894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1789127030.047677:0:17894:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789127030.048289:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99422d564ed8) 00000020:00000080:0.0:1789127030.048307:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789127030.048380:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789127030.048386:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebb65 00000020:00000080:2.0:1789127030.054155:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789127030.061026:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa840b4da666ebb6c 00000020:00000080:0.0:1789127030.061407:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789127030.061418:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.061423:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.061426:0:17894:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789127030.061428:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127030.061431:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789127030.061432:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127030.061434:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127030.061435:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127030.061438:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.061439:0:17894:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127030.061442:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.061525:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.061528:0:17894:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789127030.061534:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789127030.061569:0:17894:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789127030.061583:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.061585:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.061587:0:17894:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789127030.061589:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.061593:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.061594:0:17894:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789127030.061596:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127030.061601:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:0.0:1789127030.061625:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127030.061638:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99422d563490) 00000020:00000080:0.0:1789127030.061733:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789127030.061740:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127030.061855:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789127030.061860:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789127030.061866:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebb7a 00010000:00080000:0.0:1789127030.061897:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994104282800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127030.064419:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789127030.066380:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127030.066393:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789127030.066424:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789127030.066442:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebb81 00000100:00080000:0.0:1789127030.066512:0:17894:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127030.066519:0:17894:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994104282800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127030.066558:0:17894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488de00 x1876035276806912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127030.066585:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789127030.066627:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276806912:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789127030.066643:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.066686:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.066689:0:17894:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789127030.066693:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127030.066697:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789127030.066699:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127030.066701:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127030.066702:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127030.066705:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.066707:0:17894:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127030.066710:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127030.066715:0:17894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789127030.066718:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.066720:0:17894:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789127030.066723:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127030.066726:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000100:00100000:3.0:1789127030.066732:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127030.066821:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276806912 00000100:00100000:2.0:1789127030.066829:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276806912 00000100:00100000:2.0:1789127030.066872:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127030.066881:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276806912:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789127030.066897:0:17881:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1789127030.069574:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789127030.069583:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127030.069599:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99422d561a48) 00000020:00000080:0.0:1789127030.069618:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789127030.069625:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127030.069753:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789127030.069760:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789127030.069771:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebb8f 00010000:00080000:0.0:1789127030.069814:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941032b3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789127030.070154:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789127030.076149:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789127030.076961:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789127030.079255:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127030.079900:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789127030.086486:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789127030.088572:0:17900:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127030.088579:0:17900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127030.093390:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127030.093406:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127030.093873:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127030.093893:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebb96 00000100:00080000:3.0:1789127030.093905:0:17894:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127030.093911:0:17894:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9941032b3800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127030.093980:0:17894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104809e00 x1876035276807040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127030.094067:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789127030.094122:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276807040:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1789127030.094179:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:0.0:1789127030.094180:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276807040 offset 0 length 520: 4 00000020:00000080:3.0:1789127030.094186:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127030.094189:0:17894:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127030.094193:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127030.094197:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789127030.094199:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127030.094200:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127030.094202:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127030.094205:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127030.094206:0:17894:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127030.094210:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127030.094214:0:17894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789127030.094218:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127030.094220:0:17894:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127030.094223:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127030.094227:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:3.0:1789127030.094248:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789127030.094250:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127030.094262:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff994238d4b490) 00000020:00000080:3.0:1789127030.094273:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789127030.094277:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127030.094381:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789127030.094388:0:17894:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789127030.094395:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ebba4 00010000:00080000:3.0:1789127030.094426:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422043b000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127030.094910:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789127030.094978:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789127030.094992:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789127030.097253:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127030.097603:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789127030.097886:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789127030.099671:0:17902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789127030.099683:0:17902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789127030.101349:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789127030.101361:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789127030.101411:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789127030.101429:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebbab 00000100:00080000:1.0:1789127030.101441:0:17894:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127030.101447:0:17894:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422043b000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127030.101488:0:17894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941043e7c00 x1876035276807168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127030.101517:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789127030.101586:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127030.101590:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127030.101592:0:17894:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789127030.101595:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127030.101599:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127030.101601:0:17894:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789127030.101610:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127030.101612:0:17894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789127030.101615:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127030.101618:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127030.101619:0:17894:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789127030.101621:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127030.101624:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127030.101625:0:17894:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789127030.101629:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789127030.101678:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17894:1876035276807296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.101698:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276807168:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789127030.101751:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276807168 offset 0 length 520: 4 00000100:00100000:1.0:1789127030.101760:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127030.104545:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807296 00000100:00100000:1.0:1789127030.104557:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807296 00000100:00100000:2.0:1789127030.104588:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276806912:12345-0@lo:38:llog_process_th.0 Request processed in 37701us (37852us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127030.104600:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127030.104608:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127030.104618:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17894:x1876035276807296:12345-0@lo:502:llog_process_th.0 00000100:00080000:0.0:1789127030.104733:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127030.104740:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789127030.104744:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276806912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127030.104854:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17894:x1876035276807296:12345-0@lo:502:llog_process_th.0 Request processed in 237us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.104862:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127030.104909:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.105085:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17894:1876035276807296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127030.105114:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127030.105121:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127030.105124:0:17894:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127030.105129:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789127030.105230:0:17856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789127030.105265:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789127030.105290:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.105301:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127030.105310:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9941050e6800 from 1 10000000:01000000:0.0:1789127030.105312:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127030.105358:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.105367:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.105377:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127030.105396:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127030.105435:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.105463:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127030.105494:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807424 00000100:00100000:3.0:1789127030.105504:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807424 00000100:00100000:3.0:1789127030.105542:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127030.105550:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+9:17856:x1876035276807424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127030.105560:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127030.105575:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebbb2 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.105599:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 10 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.105612:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 10 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.105621:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67400, rc 0) 00000100:00100000:3.0:1789127030.105695:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+10:17856:x1876035276807424:12345-0@lo:101:mount.lustre.0 Request processed in 145us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127030.105959:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127030.106063:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127030.106079:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.106088:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127030.107747:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807552:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789127030.107819:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127030.107865:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807552 00000100:00100000:1.0:1789127030.107866:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127030.107873:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807552 00000100:00100000:2.0:1789127030.107927:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127030.107937:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+10:17856:x1876035276807552:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789127030.107955:0:17870:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789127030.107961:0:17870:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789127030.108051:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+10:17856:x1876035276807552:12345-0@lo:256:mount.lustre.0 Request processed in 115us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127030.108060:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127030.108111:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807552:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789127030.110041:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127030.110119:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.110132:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127030.110141:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9941050e6800 from 1 10000000:01000000:1.0:1789127030.110143:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127030.110181:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.110190:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.110201:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127030.110222:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127030.110278:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127030.110318:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127030.111846:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807680 00000100:00100000:3.0:1789127030.111857:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807680 00000100:00100000:3.0:1789127030.111932:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127030.111944:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+10:17856:x1876035276807680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127030.111960:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127030.111979:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebbc0 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.112007:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 11 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.112033:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 11 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.112043:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b66e00, rc 0) 00000100:00100000:3.0:1789127030.112123:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276807680:12345-0@lo:101:mount.lustre.0 Request processed in 181us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127030.112131:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127030.113951:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127030.113980:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.113994:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127030.114082:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127030.114134:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.114182:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.114354:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807808 00000100:00100000:1.0:1789127030.114360:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807808 00000100:00100000:1.0:1789127030.114418:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127030.114427:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276807808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127030.114574:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276807808:12345-0@lo:501:mount.lustre.0 Request processed in 149us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.114583:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127030.115203:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127030.115238:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127030.115285:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.115319:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.115482:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276807936 00000100:00100000:1.0:1789127030.115487:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276807936 00000100:00100000:1.0:1789127030.115523:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127030.115531:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276807936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127030.115617:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276807936:12345-0@lo:503:mount.lustre.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.115624:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127030.115861:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276807936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127030.116566:0:17904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17904:1876035276808064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.116624:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.116690:0:17904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.116777:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808064 00000100:00100000:1.0:1789127030.116783:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808064 00000100:00100000:1.0:1789127030.116827:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127030.116837:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17904:x1876035276808064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127030.117728:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17904:x1876035276808064:12345-0@lo:502:llog_process_th.0 Request processed in 890us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.117738:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127030.117830:0:17904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17904:1876035276808064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127030.117863:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.117873:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.117875:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789127030.117882:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9941050e6800 00000020:00000080:0.0:1789127030.117885:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127030.117893:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.117896:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.117903:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789127030.117906:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.117908:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.117910:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789127030.117913:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9941050e6800 00000020:00000080:0.0:1789127030.117915:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127030.117975:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.117978:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.117980:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789127030.117982:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.117984:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.117985:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127030.117989:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9941050e6800 00000020:00000080:0.0:1789127030.117991:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127030.118007:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.118010:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118011:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127030.118014:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.118016:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118017:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127030.118020:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9941050e6800 00000020:00000080:0.0:1789127030.118022:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127030.118036:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.118038:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118039:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127030.118042:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.118044:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118045:0:17904:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127030.118049:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9941050e6800 00000020:00000080:0.0:1789127030.118051:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127030.118065:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.118068:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118069:0:17904:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127030.118077:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127030.118080:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.118082:0:17904:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789127030.118085:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9941050e6800 00000020:00000080:0.0:1789127030.118087:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127030.118131:0:17904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17904:1876035276808192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.118174:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.118214:0:17904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.124642:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808192 00000100:00100000:1.0:1789127030.124676:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808192 00000100:00100000:1.0:1789127030.124745:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789127030.124756:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17904:x1876035276808192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127030.124952:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17904:x1876035276808192:12345-0@lo:502:llog_process_th.0 Request processed in 197us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.124960:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127030.125595:0:17904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17904:1876035276808192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127030.125630:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127030.125640:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127030.125643:0:17904:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789127030.125677:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789127030.125996:0:17856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789127030.126015:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127030.126039:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127030.126051:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127030.126100:0:17856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127030.126103:0:17856:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9941050e6800 10000000:01000000:2.0:1789127030.126113:0:17856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9941050e6800 10000000:01000000:2.0:1789127030.126117:0:17856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127030.126124:0:17856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9941050e6800 from 1 10000000:01000000:2.0:1789127030.126126:0:17856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127030.126162:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127030.126171:0:17856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127030.126181:0:17856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127030.126202:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127030.126252:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127030.126288:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.126578:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808320 00000100:00100000:1.0:1789127030.126584:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808320 00000100:00100000:1.0:1789127030.126622:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127030.126631:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276808320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127030.126641:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127030.126676:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104396200/0xa840b4da666ebbd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebbce expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.126712:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104396200/0xa840b4da666ebbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebbce expref: 12 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.126726:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104396200/0xa840b4da666ebbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbce expref: 12 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.126736:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396200, rc 0) 00000100:00100000:1.0:1789127030.126785:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276808320:12345-0@lo:101:mount.lustre.0 Request processed in 155us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.126792:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127030.127640:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127030.127777:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127030.127791:0:17856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127030.127875:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127030.127915:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127030.127988:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.140071:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808448 00000100:00100000:0.0:1789127030.140088:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808448 00000100:00100000:0.0:1789127030.140155:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127030.140168:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276808448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127030.140379:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276808448:12345-0@lo:501:mount.lustre.0 Request processed in 213us (12463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.140388:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127030.140989:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127030.141041:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127030.141096:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127030.141132:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.141204:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808576 00000100:00100000:0.0:1789127030.141209:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808576 00000100:00100000:0.0:1789127030.141237:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127030.141246:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276808576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127030.141414:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276808576:12345-0@lo:503:mount.lustre.0 Request processed in 168us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.141422:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127030.141634:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276808576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127030.153762:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276808704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.153851:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.153901:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127030.153981:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808704 00000100:00100000:1.0:1789127030.153989:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808704 00000100:00100000:1.0:1789127030.154043:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127030.154054:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276808704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127030.154180:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276808704:12345-0@lo:502:llog_process_th.0 Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.154188:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127030.154287:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276808704:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789127030.154535:0:17909:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789127030.154551:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99423d001a48) 00000020:00000080:0.0:1789127030.154569:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789127030.155720:0:17909:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9941050e6800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127030.155729:0:17909:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9941050e6800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789127030.155732:0:17909:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9941050e6800 4 00010000:00080000:0.0:1789127030.155768:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994210e00800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789127030.165200:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789127030.168603:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789127030.168666:0:17909:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127030.168681:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa840b4da666ebbe3 00000100:00080000:0.0:1789127030.168693:0:17909:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127030.168699:0:17909:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994210e00800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127030.168739:0:17909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488e1c0 x1876035276808832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127030.168779:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276808832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127030.168848:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.168919:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808832 00000100:00100000:0.0:1789127030.168927:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808832 00000100:00100000:0.0:1789127030.168967:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127030.168975:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276808832:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127030.169030:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276808832:12345-0@lo:38:llog_process_th.0 Request processed in 54us (181us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789127030.169047:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127030.169081:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127030.169089:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994210e00800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127030.169103:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789127030.169107:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276808832:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789127030.169124:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789127030.180459:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276808960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.180540:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.180578:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276808960 00000100:00100000:0.0:1789127030.180586:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276808960 00000100:00100000:0.0:1789127030.180630:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127030.180639:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276808960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.180774:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276808960:12345-0@lo:502:llog_process_th.0 Request processed in 135us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.180782:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127030.180825:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.180844:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276808960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.180884:0:17909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276809088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.180916:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127030.180935:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809088 00000100:00100000:0.0:1789127030.180939:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809088 00000100:00100000:0.0:1789127030.180960:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127030.180967:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276809088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127030.181027:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17909:x1876035276809088:12345-0@lo:502:llog_process_th.0 Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.181039:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127030.181067:0:17909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.181079:0:17909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17909:1876035276809088:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789127030.181095:0:17909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789127030.181151:0:17856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127030.181176:0:17856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127030.181191:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.181202:0:17856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127030.181243:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127030.181245:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127030.181247:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127030.181248:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127030.181249:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127030.181251:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127030.181252:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127030.181257:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127030.181259:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127030.181261:0:17856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127030.181264:0:17856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789127030.181266:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127030.181268:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127030.181269:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127030.181269:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127030.181270:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127030.181271:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127030.181272:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127030.181273:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127030.181273:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127030.181274:0:17856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127030.181287:0:17856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789127030.181296:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276809216:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127030.181336:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127030.181357:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.182318:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809216 00000100:00100000:0.0:1789127030.182325:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809216 00000100:00100000:0.0:1789127030.182368:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127030.182376:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17856:x1876035276809216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127030.182400:0:17872:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789127030.182413:0:17872:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789127030.192678:0:17872:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789127030.195378:0:17872:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789127030.195743:0:17892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789127030.195748:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789127030.195772:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.195790:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 12 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.195798:0:17892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.195836:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 12 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.195851:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 12 pid: 17872 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127030.195875:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276809344:0@lo:104: 00000100:00100000:3.0:1789127030.195951:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127030.195990:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942189ddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127030.196856:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809344 00000100:00100000:3.0:1789127030.196865:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809344 00000100:00100000:3.0:1789127030.196913:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127030.196924:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276809344:12345-0@lo:104: 00010000:00010000:3.0:1789127030.196938:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197000:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127030.197006:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276809344:12345-0@lo:104: Request processed in 85us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127030.197015:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127030.197054:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276809344:0@lo:104: 00010000:00010000:3.0:1789127030.197074:0:17892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197091:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127030.197097:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197104:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127030.197108:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197116:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127030.197130:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127030.197136:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127030.197166:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197173:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127030.197201:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197209:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212167800/0xa840b4da666ebbb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbb9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.197223:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127030.197225:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127030.197226:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127030.197226:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276809472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127030.197259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127030.200694:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809472 00000100:00100000:1.0:1789127030.200708:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809472 00010000:00010000:1.0:1789127030.200750:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 13 pid: 17872 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127030.200813:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127030.200824:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+13:3641:x1876035276809472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127030.200840:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127030.200846:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 13 pid: 17872 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200860:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 13 pid: 17872 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200879:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67400/0xa840b4da666ebbb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebbb2 expref: 13 pid: 17872 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200893:0:17862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200902:0:17862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127030.200918:0:17862:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005170377s 00010000:00010000:1.0:1789127030.200923:0:17862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200929:0:17862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200936:0:17862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200942:0:17862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200954:0:17862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127030.200959:0:17862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200967:0:17862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.200991:0:17862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127030.201003:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127030.201052:0:17892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.201060:0:17892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.201066:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b66a00/0xa840b4da666ebbea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127030.201088:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:3641:x1876035276809472:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.201097:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127030.201727:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276809472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127030.208890:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17856:x1876035276809216:12345-0@lo:253:mount.lustre.0 Request processed in 26507us (27554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127030.208904:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127030.208970:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17856:1876035276809216:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127030.208984:0:17856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789127030.208988:0:17856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127030.208990:0:17856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127030.208992:0:17856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127030.208993:0:17856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127030.208994:0:17856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127030.208996:0:17856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127030.208997:0:17856:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127030.208999:0:17856:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127030.209001:0:17856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127030.209008:0:17856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789127030.209023:0:17856:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1789127030.239163:0:17856:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789127030.241741:0:17856:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789127030.242066:0:17919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:3.0:1789127030.242111:0:17918:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789127030.242114:0:17918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789127030.242446:0:17919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789127030.244620:0:17856:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789127030.246191:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127030.251864:0:17919:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1789127030.255740:0:17920:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9941043e5a40 x1876035276809600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127030.255755:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000040:01000000:3.0:1789127030.256037:0:17856:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789127030.256071:0:17856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789127030.256919:0:17856:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789127030.257005:0:17856:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789127030.257056:0:17856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127030.258981:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789127030.259584:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789127030.259618:0:17856:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789127030.261178:0:17856:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789127030.263803:0:17856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789127030.265405:0:17856:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789127030.265438:0:17856:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb30540e33988 00100000:10000000:3.0:1789127030.265447:0:17856:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789127030.268802:0:17856:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789127030.268820:0:17856:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789127030.268840:0:17856:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789127030.268881:0:17856:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789127030.271154:0:17856:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127030.271366:0:17856:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127030.826921:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127030.954773:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127030.954782:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9941050e6800 from 7 10000000:01000000:3.0:1789127030.954787:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127030.954844:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.954856:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.954869:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127030.954895:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276809728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127030.954968:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127030.955029:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.955109:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809728 00000100:00100000:0.0:1789127030.955122:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809728 00000100:00100000:0.0:1789127030.955183:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127030.955192:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+11:17874:x1876035276809728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127030.955205:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127030.955221:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebbf1 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.955246:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.955257:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127030.955278:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166000, rc 0) 00000100:00100000:0.0:1789127030.955339:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17874:x1876035276809728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.955346:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127030.955456:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276809728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127030.955471:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.955490:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127030.955538:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276809856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127030.955571:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127030.955596:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127030.955638:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809856 00000100:00100000:0.0:1789127030.955643:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809856 00000100:00100000:0.0:1789127030.955789:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127030.955797:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17874:x1876035276809856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127030.955812:0:17872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127030.955828:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127030.955831:0:17872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789127030.955913:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:17874:x1876035276809856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127030.955921:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127030.955995:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276809856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127030.956036:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127030.956043:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127030.956051:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127031.218051:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127031.278755:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:1.0:1789127031.851035:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127032.238357:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789127032.301415:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127032.893103:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127033.324954:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127033.898837:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127034.353748:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000001:02000400:0.0:1789127034.555345:0:18163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127034.922991:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127035.370991:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000100:00080000:2.0:1789127035.564813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127035.564821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789127035.564825:0:8:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127035.564833:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1789127035.564840:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127035.564847:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994104282800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127035.564869:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994105018f00 x1876035276810112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127035.564881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127035.564884:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127035.564887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127035.564890:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127035.564892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127035.564896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127035.564897:0:8:0:(import.c:65:import_set_state_nolock()) ffff994210e00800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127035.564900:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994210e00800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127035.564908:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994105019a40 x1876035276810240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127035.564973:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276809984:0@lo:400:kworker.0 00000100:00100000:3.0:1789127035.565041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127035.568710:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810112:0@lo:38:kworker.0 00000100:00100000:1.0:1789127035.568885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127035.568899:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809984 00000100:00100000:2.0:1789127035.568909:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809984 00000100:00100000:2.0:1789127035.568960:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127035.568970:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:3642:x1876035276809984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127035.569023:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:3642:x1876035276809984:12345-0@lo:400:kworker.0 Request processed in 55us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127035.569030:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127035.569132:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276809984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127035.570258:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276810112 00000100:00100000:0.0:1789127035.570264:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276810112 00000100:00100000:1.0:1789127035.570287:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276810240:0@lo:38:kworker.0 00000100:00100000:0.0:1789127035.570306:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127035.570312:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276810112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789127035.570330:0:17882:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127035.570345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127035.572750:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276810240 00000100:00100000:1.0:1789127035.572764:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276810240 00000100:00100000:1.0:1789127035.572838:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127035.572846:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276810240:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789127035.572874:0:17877:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1789127035.572913:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa840b4da666ebbff 00000004:00100000:1.0:1789127035.572943:0:17877:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789127035.573088:0:17877:0:(import.c:65:import_set_state_nolock()) ffff9942118e3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127035.573167:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876035276810240:12345-0@lo:38:kworker.0 Request processed in 320us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127035.573182:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127035.573237:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994105019a40 x1876035276810240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127035.573255:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789127035.573262:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789127035.573267:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789127035.573269:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994210e00800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789127035.573275:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276810240:0@lo:38:kworker.0 00000100:00100000:0.0:1789127035.590374:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276810112:12345-0@lo:38:kworker.0 Request processed in 20051us (21481us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127035.590392:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789127035.591164:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127035.591177:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789127035.591182:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810112:0@lo:38:kworker.0 00000020:00000004:2.0:1789127035.615178:0:18216:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127035.615489:0:18216:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127035.951490:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127036.395138:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000020:00000004:0.0:1789127036.499111:0:18266:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127036.499370:0:18266:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127036.971394:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127037.418854:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127037.999151:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127038.442738:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127039.020374:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127039.466726:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:1.0:1789127040.042818:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127040.491147:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000100:00100000:2.0:1789127040.682874:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127030/real 1789127030] req@ffff9941043e7c00 x1876035276807168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127040.682915:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9941043e7c00 x1876035276807168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127040.682925:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127030/real 1789127030] req@ffff994104809e00 x1876035276807040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127040.682936:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104809e00 x1876035276807040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127040.682952:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127040.682975:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127040.682979:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276807168:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789127040.682985:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127040.682991:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127040.683001:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276807040:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789127040.683162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789127040.683167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789127040.683170:0:36:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127040.683176:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1789127040.683181:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789127040.683187:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994104282800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127040.683298:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941048083c0 x1876035276810496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127040.683325:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276810368:0@lo:400:kworker.0 00000100:00100000:1.0:1789127040.683392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127040.683429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127040.683432:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789127040.683434:0:36:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127040.683438:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789127040.683441:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127040.683444:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9941032b3800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127040.683451:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276810368 00000100:00100000:1.0:1789127040.683457:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276810368 00000100:00100000:3.0:1789127040.683458:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104809a40 x1876035276810624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127040.683465:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127040.683467:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127040.683469:0:36:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127040.683472:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789127040.683474:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127040.683477:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422043b000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127040.683485:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104808000 x1876035276810752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127040.683497:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127040.683506:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:3639:x1876035276810368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127040.683512:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127040.683518:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276810880:0@lo:400:kworker.0 00000100:00100000:1.0:1789127040.683551:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:3639:x1876035276810368:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127040.683558:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127040.683596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127040.683667:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276810368:0@lo:400:kworker.0 00000100:00100000:3.0:1789127040.683685:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810496:0@lo:38:kworker.0 00000100:00100000:3.0:1789127040.683711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127040.683739:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810624:0@lo:8:kworker.0 00000400:00000100:3.0:1789127040.683760:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276810624 offset 0 length 520: 4 00000100:00100000:3.0:1789127040.683777:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810752:0@lo:8:kworker.0 00000400:00000100:3.0:1789127040.683811:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276810752 offset 0 length 520: 4 00000100:00100000:1.0:1789127040.683835:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276810880 00000100:00100000:3.0:1789127040.683836:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276810496 00000100:00100000:3.0:1789127040.683839:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276810496 00000100:00100000:1.0:1789127040.683839:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276810880 00000100:00100000:3.0:1789127040.683861:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127040.683865:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276810496:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789127040.683881:0:17881:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127040.683963:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127040.683976:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276810880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127040.684011:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276810880:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127040.684016:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127040.704141:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410480b0c0 x1876035276810880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127040.704161:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276810880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127040.704281:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276810496:12345-0@lo:38:kworker.0 Request processed in 20413us (20568us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127040.704292:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789127040.704340:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127040.704347:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789127040.704351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941048083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810496:0@lo:38:kworker.0 00010000:00010000:0.0:1789127041.066865:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127041.515731:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127042.091521:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127042.475284:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789127042.539531:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127043.118384:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127043.563027:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000020:01000004:2.0:1789127043.892723:0:18612:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127043.892728:0:18612:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789127043.892729:0:18612:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789127043.892846:0:18612:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99422035d800 00000020:01000004:2.0:1789127043.892862:0:18612:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789127043.892874:0:18612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789127043.892888:0:18612:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9942366bb490) 00000020:00000080:2.0:1789127043.892903:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789127044.034870:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789127044.036540:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127044.037839:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789127044.038354:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789127044.038761:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789127044.039849:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789127044.040645:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.044543:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.046396:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.047825:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.049414:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.051304:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.052869:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.053802:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.054398:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.054785:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.055591:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.056760:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.057438:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.057827:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.059370:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.060452:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.060880:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.061379:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.062003:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.062860:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.063384:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789127044.063763:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789127044.064004:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789127044.065068:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789127044.065741:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789127044.065997:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789127044.066527:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789127044.066954:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789127044.070430:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.070795:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789127044.071837:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.072147:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789127044.072527:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789127044.072909:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.073388:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789127044.073806:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.074123:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789127044.074537:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.075165:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789127044.075768:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1789127044.077415:0:18612:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789127044.077629:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789127044.077641:0:18612:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789127044.078423:0:18612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebc0d 00000020:01000004:0.0:1789127044.078433:0:18612:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789127044.078457:0:18612:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789127044.078460:0:18612:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789127044.078467:0:18612:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789127044.078494:0:18612:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789127044.078498:0:18612:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789127044.084500:0:18612:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127044.084539:0:18612:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789127044.084544:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127044.084546:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127044.084547:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127044.084548:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127044.084550:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127044.084551:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127044.084552:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127044.084554:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127044.084555:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127044.084558:0:18612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789127044.084561:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127044.084562:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127044.084563:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127044.084564:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127044.084565:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127044.084566:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127044.084567:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127044.084568:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127044.084569:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127044.084756:0:18612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789127044.084776:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127044.084855:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.084963:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421826fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.085215:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811008 00000100:00100000:2.0:1789127044.085295:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811008 00000100:00100000:2.0:1789127044.085357:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127044.085473:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:18612:x1876035276811008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127044.085507:0:17871:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789127044.085510:0:17871:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789127044.085518:0:17871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789127044.086427:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:18612:x1876035276811008:12345-0@lo:253:mount.lustre.0 Request processed in 954us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.086438:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127044.086565:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127044.086578:0:18612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789127044.086809:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127044.086813:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127044.086814:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127044.086815:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127044.086817:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127044.086818:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127044.086819:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127044.086821:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127044.086822:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127044.086843:0:18612:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99422035d800 from lustre-MDT0001 10000000:01000000:0.0:1789127044.086871:0:18612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789127044.086874:0:18612:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789127044.086880:0:18612:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994103ec8000 local copy 00010000:00010000:0.0:1789127044.086892:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127044.087304:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127044.087351:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.087513:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421826fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.087559:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811136 00000100:00100000:2.0:1789127044.087565:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811136 00000100:00100000:0.0:1789127044.088068:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127044.088093:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:18612:x1876035276811136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127044.088189:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:18612:x1876035276811136:12345-0@lo:501:mount.lustre.0 Request processed in 99us (837us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127044.088197:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789127044.088277:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811136:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789127044.088308:0:18612:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789127044.088330:0:18612:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789127044.088338:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.088348:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.088389:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99422035d800 10000000:01000000:2.0:1789127044.088393:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127044.088399:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff994103ec8000 10000000:01000000:2.0:1789127044.088401:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789127044.088405:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff994103ec8000 from 1 10000000:01000000:2.0:1789127044.088408:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789127044.088437:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.088446:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.088455:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127044.088471:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127044.088501:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.088537:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.088684:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811264 00000100:00100000:0.0:1789127044.088689:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811264 00000100:00100000:0.0:1789127044.088731:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127044.088738:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+12:18612:x1876035276811264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127044.088747:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127044.088761:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166c00/0xa840b4da666ebc1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebc14 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.088784:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166c00/0xa840b4da666ebc1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebc14 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.088796:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166c00/0xa840b4da666ebc1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebc14 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.088805:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166c00, rc 0) 00000100:00100000:0.0:1789127044.088832:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+13:18612:x1876035276811264:12345-0@lo:101:mount.lustre.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.088838:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127044.089275:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127044.089289:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.089305:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.089323:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789127044.089342:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.089350:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.089366:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99422035d800 10000000:01000000:2.0:1789127044.089370:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789127044.089374:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99422035d800 from 1 10000000:01000000:2.0:1789127044.089376:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789127044.089392:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.089398:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.089406:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127044.089418:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127044.089446:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.089465:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127044.089706:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811392 00000100:00100000:3.0:1789127044.089712:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811392 00000100:00100000:3.0:1789127044.089743:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127044.089751:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+13:18612:x1876035276811392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127044.089759:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127044.089770:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67000/0xa840b4da666ebc29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebc22 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.089785:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67000/0xa840b4da666ebc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebc22 expref: 14 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.089805:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67000/0xa840b4da666ebc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebc22 expref: 14 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.089812:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67000, rc 0) 00000100:00100000:3.0:1789127044.089844:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+14:18612:x1876035276811392:12345-0@lo:101:mount.lustre.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.089851:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127044.089993:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127044.090006:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.090028:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.090039:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789127044.090043:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.090050:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.090056:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789127044.090060:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127044.090064:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99422035d800 10000000:01000000:2.0:1789127044.090066:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789127044.090085:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789127044.090088:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789127044.090102:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.090112:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.090118:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127044.090130:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127044.090153:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.090179:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.090520:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811520 00000100:00100000:0.0:1789127044.090525:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811520 00000100:00100000:0.0:1789127044.090547:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127044.090553:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+14:18612:x1876035276811520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127044.090560:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127044.090569:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166200/0xa840b4da666ebc37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebc30 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.090591:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166200/0xa840b4da666ebc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebc30 expref: 15 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.090599:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166200/0xa840b4da666ebc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebc30 expref: 15 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.090617:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166200, rc 0) 00000100:00100000:0.0:1789127044.090677:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811520:12345-0@lo:101:mount.lustre.0 Request processed in 95us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.090684:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127044.090903:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127044.090915:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.090922:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127044.092862:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789127044.094918:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127044.103123:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789127044.103180:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789127044.103197:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789127044.103211:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789127044.103225:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789127044.103249:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789127044.103264:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789127044.103277:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789127044.103291:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789127044.103302:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789127044.103312:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789127044.103325:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789127044.103338:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789127044.103352:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789127044.103832:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789127044.103848:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789127044.103861:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789127044.103874:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789127044.103888:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789127044.103903:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789127044.103917:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789127044.103931:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789127044.103943:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789127044.103993:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789127044.104000:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789127044.104129:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127044.104199:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.104249:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.104369:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811648 00000100:00100000:0.0:1789127044.104377:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811648 00000100:00100000:0.0:1789127044.104430:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127044.104440:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127044.104590:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811648:12345-0@lo:501:mount.lustre.0 Request processed in 151us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.104599:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127044.105180:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127044.105220:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127044.105274:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.105307:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236415e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.105821:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811776 00000100:00100000:0.0:1789127044.105827:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811776 00000100:00100000:0.0:1789127044.105858:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127044.105866:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127044.107523:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811776:12345-0@lo:503:mount.lustre.0 Request processed in 1650us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.107536:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127044.115467:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127044.116909:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127044.117822:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127044.117912:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.117951:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942364156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127044.118043:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276811904 00000100:00100000:1.0:1789127044.118052:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276811904 00000100:00100000:1.0:1789127044.118120:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127044.118131:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127044.121924:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276811904:12345-0@lo:502:mount.lustre.0 Request processed in 3785us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.121939:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127044.122951:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276811904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.124280:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789127044.124323:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789127044.124339:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789127044.124422:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789127044.124447:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789127044.124464:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789127044.124479:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789127044.124492:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789127044.124506:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789127044.124520:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789127044.124534:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789127044.124549:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789127044.124563:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789127044.124576:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789127044.124982:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789127044.125263:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789127044.125280:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789127044.125295:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789127044.125310:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789127044.125324:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789127044.125336:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789127044.125350:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789127044.125439:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789127044.125455:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789127044.125467:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789127044.125496:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789127044.125508:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789127044.125520:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789127044.125532:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789127044.125544:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789127044.125557:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789127044.125568:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789127044.126304:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789127044.126344:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789127044.126508:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789127044.126526:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789127044.126540:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789127044.126554:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789127044.126568:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789127044.126737:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789127044.126760:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789127044.126776:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789127044.126790:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789127044.126804:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789127044.126858:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276812032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127044.126951:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.127316:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812032 00000100:00100000:0.0:1789127044.127324:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812032 00000100:00100000:0.0:1789127044.127446:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127044.127458:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276812032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127044.127579:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276812032:12345-0@lo:502:mount.lustre.0 Request processed in 123us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.127846:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127044.127871:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276812032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.127929:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789127044.127940:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000100:00100000:0.0:1789127044.131321:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:01000000:3.0:1789127044.133481:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127044.133495:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.133497:0:18616:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789127044.133503:0:18616:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789127044.133506:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127044.133522:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff994238d49a48) 00000020:00000080:3.0:1789127044.133549:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789127044.133555:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789127044.133857:0:18616:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127044.133866:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebc45 00000020:00000080:3.0:1789127044.134335:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789127044.134341:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.134345:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.134347:0:18616:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789127044.134350:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127044.134353:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.134421:0:18616:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789127044.134428:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127044.134436:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff994238d48000) 00000020:00000080:3.0:1789127044.134449:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789127044.134453:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789127044.134455:0:18616:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789127044.134458:0:18616:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789127044.134464:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127044.134529:0:18616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99422035d800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789127044.134543:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff994238d4ced8) 00000020:00000080:3.0:1789127044.134555:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789127044.134895:0:18616:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789127044.134902:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebc5a 00000020:00000080:3.0:1789127044.135973:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789127044.136007:0:18616:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789127044.136025:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa840b4da666ebc61 00080000:01000000:3.0:1789127044.136035:0:18616:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789127044.136039:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebc68 00010000:00010000:0.0:1789127044.138767:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127044.251470:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789127044.253025:0:18616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789127044.255214:0:18616:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789127044.262925:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789127044.262943:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.262951:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.262954:0:18616:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789127044.262958:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127044.262974:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.262976:0:18616:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789127044.262980:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127044.262985:0:18616:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:3.0:1789127044.263014:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127044.263030:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9942290f0000) 00000020:00000080:3.0:1789127044.263052:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789127044.263058:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127044.263161:0:18616:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789127044.263167:0:18616:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789127044.263175:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebc76 00010000:00080000:3.0:1789127044.263210:0:18616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99423d03f000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127044.268619:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789127044.273113:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127044.273130:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789127044.273170:0:18616:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789127044.273194:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebc7d 00000100:00080000:0.0:1789127044.273206:0:18616:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127044.273212:0:18616:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99423d03f000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127044.273262:0:18616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488c3c0 x1876035276812160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127044.273295:0:18616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789127044.273350:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127044.273538:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273541:0:18616:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789127044.273546:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127044.273549:0:18616:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789127044.273551:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127044.273552:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127044.273554:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127044.273556:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273558:0:18616:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127044.273561:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127044.273565:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273567:0:18616:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789127044.273570:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789127044.273613:0:18616:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789127044.273628:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127044.273631:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273633:0:18616:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789127044.273635:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127044.273637:0:18616:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789127044.273639:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127044.273640:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127044.273695:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127044.273698:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273700:0:18616:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127044.273703:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127044.273707:0:18616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789127044.273710:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127044.273712:0:18616:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000100:00080000:2.0:1789127044.274117:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127044.274122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789127044.274126:0:8:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127044.274130:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1789127044.274135:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789127044.274148:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994104282800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127044.274168:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b840 x1876035276812288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127044.274180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127044.274184:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127044.274188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127044.274192:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127044.274249:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276812416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127044.274320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.274628:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127044.274706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.274742:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276812288:0@lo:38:kworker.0 00000100:00100000:3.0:1789127044.274764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.274800:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812160 00000100:00100000:3.0:1789127044.274807:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812160 00000100:00100000:3.0:1789127044.274832:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812288 00000100:00100000:3.0:1789127044.274834:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812288 00000100:00100000:3.0:1789127044.274848:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127044.274857:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276812160:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127044.274884:0:17882:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1789127044.274920:0:17882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebc84 00000004:00100000:3.0:1789127044.274935:0:17882:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789127044.274940:0:17882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789127044.275488:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812416 00000100:00100000:1.0:1789127044.275494:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812416 00000100:00100000:1.0:1789127044.275531:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127044.275539:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276812416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127044.275610:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276812416:12345-0@lo:400:kworker.0 Request processed in 72us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.275617:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127044.275674:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410501b0c0 x1876035276812416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127044.275688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276812416:0@lo:400:kworker.0 00000020:00000080:0.0:1789127044.275864:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127044.275870:0:18616:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:0.0:1789127044.275894:0:18616:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789127044.275897:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127044.275911:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99423d004ed8) 00000020:00000080:0.0:1789127044.275926:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789127044.275932:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127044.276023:0:18616:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789127044.276029:0:18616:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789127044.276036:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebc92 00010000:00080000:0.0:1789127044.276065:0:18616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99423d063800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127044.277158:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1789127044.279229:0:18616:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789127044.281532:0:18616:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789127044.284296:0:17882:0:(import.c:65:import_set_state_nolock()) ffff99423d062800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127044.284425:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276812160:12345-0@lo:38:llog_process_th.0 Request processed in 9565us (9715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.284437:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127044.284469:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127044.284476:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276812288:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789127044.284523:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276812288:12345-0@lo:38:kworker.0 Request processed in 46us (9757us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789127044.284529:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127044.285047:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789127044.285059:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789127044.285083:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789127044.285090:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789127044.285093:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789127044.285111:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812160:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127044.285138:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789127044.285143:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127044.285146:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789127044.285149:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276812288:0@lo:38:kworker.0 00000100:00100000:0.0:1789127044.285285:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276812544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127044.285341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.285427:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812544 00000100:00100000:2.0:1789127044.285433:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812544 00000100:00100000:2.0:1789127044.285480:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127044.285489:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276812544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127044.285514:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127044.285603:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276812544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.285611:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127044.285872:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276812544:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789127044.287542:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127044.288051:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789127044.288337:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789127044.288917:0:18621:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127044.288923:0:18621:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127044.290385:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789127044.290398:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127044.290437:0:18616:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127044.290458:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebc99 00000100:00080000:3.0:1789127044.290470:0:18616:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127044.290476:0:18616:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99423d063800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127044.290519:0:18616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104809e00 x1876035276812672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127044.290548:0:18616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789127044.290606:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.290610:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.290611:0:18616:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127044.290615:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127044.290617:0:18616:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789127044.290619:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127044.290620:0:18616:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127044.290622:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127044.290624:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.290626:0:18616:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127044.290628:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127044.290632:0:18616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789127044.290635:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.290636:0:18616:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127044.290639:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127044.290642:0:18616:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000100:00080000:0.0:1789127044.290757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.290762:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127044.290764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.290766:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789127044.290828:0:18616:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789127044.290831:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127044.290842:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9942290f4ed8) 00000020:00000080:3.0:1789127044.290854:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789127044.290859:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127044.290940:0:18616:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789127044.290947:0:18616:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789127044.290953:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ebca7 00010000:00080000:3.0:1789127044.291129:0:18616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99423d039000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.123@tcp at head 00000100:00100000:1.0:1789127044.291491:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812672:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789127044.291549:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276812672 offset 0 length 520: 4 00010000:00010000:3.0:1789127044.292217:0:18616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789127044.292301:0:18616:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789127044.292317:0:18616:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789127044.294631:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127044.294966:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789127044.295303:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789127044.296305:0:18623:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789127044.296310:0:18623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789127044.297805:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789127044.297821:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127044.297867:0:18616:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789127044.297890:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebcae 00000100:00080000:3.0:1789127044.297903:0:18616:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127044.297909:0:18616:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99423d039000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127044.297953:0:18616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410480a940 x1876035276812800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127044.298112:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812800:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789127044.298171:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276812800 offset 0 length 520: 4 00000100:00080000:3.0:1789127044.298350:0:18616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789127044.298481:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.298486:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.298488:0:18616:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789127044.298491:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127044.298495:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.298496:0:18616:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127044.298499:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127044.298501:0:18616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789127044.298504:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.298506:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.298521:0:18616:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789127044.298524:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127044.298527:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.298529:0:18616:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127044.298532:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789127044.298564:0:18616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127044.298567:0:18616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127044.298568:0:18616:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789127044.298571:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1789127044.298760:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789127044.298790:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789127044.298808:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.298819:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127044.298836:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422035d800 from 1 10000000:01000000:2.0:1789127044.298838:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127044.298865:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.298874:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.298885:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127044.298903:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276812928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127044.298943:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.298969:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.299000:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276812928 00000100:00100000:2.0:1789127044.299008:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276812928 00000100:00100000:2.0:1789127044.299055:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127044.299065:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+15:18612:x1876035276812928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127044.299257:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127044.299273:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebcb5 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.299300:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 16 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.299311:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 16 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.299331:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3800, rc 0) 00000100:00100000:2.0:1789127044.299385:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:18612:x1876035276812928:12345-0@lo:101:mount.lustre.0 Request processed in 321us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.299393:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127044.299443:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276812928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127044.299457:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127044.299465:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127044.300925:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813056:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789127044.300980:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127044.301222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.301228:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127044.301243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.301247:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127044.301466:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.301639:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813056 00000100:00100000:0.0:1789127044.301832:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813056 00000100:00100000:2.0:1789127044.301990:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127044.302002:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:18612:x1876035276813056:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789127044.302022:0:17872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789127044.302042:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789127044.302045:0:17872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789127044.302290:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:18612:x1876035276813056:12345-0@lo:256:mount.lustre.0 Request processed in 289us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.302299:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127044.302384:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813056:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789127044.303331:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127044.303362:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.303376:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127044.303384:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422035d800 from 1 10000000:01000000:3.0:1789127044.303387:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127044.303424:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.303431:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.303441:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127044.303461:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127044.303502:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.304001:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127044.304267:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813184 00000100:00100000:1.0:1789127044.304275:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813184 00000100:00100000:1.0:1789127044.304317:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127044.304326:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:18612:x1876035276813184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127044.304340:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127044.304364:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebcc3 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.304391:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 17 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.304404:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 17 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.304414:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396c00, rc 0) 00000100:00100000:1.0:1789127044.304467:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813184:12345-0@lo:101:mount.lustre.0 Request processed in 141us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.304480:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127044.304626:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127044.304643:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.304686:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127044.304812:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127044.304845:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127044.304879:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.305227:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.305297:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813312 00000100:00100000:2.0:1789127044.305304:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813312 00000100:00100000:2.0:1789127044.305333:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127044.305339:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127044.305454:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813312:12345-0@lo:501:mount.lustre.0 Request processed in 114us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.305461:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127044.305597:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127044.305626:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127044.305694:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.305713:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.305817:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813440 00000100:00100000:2.0:1789127044.305822:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813440 00000100:00100000:2.0:1789127044.305840:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127044.305846:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127044.305928:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813440:12345-0@lo:503:mount.lustre.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.305936:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127044.306009:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127044.306875:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127044.306947:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127044.307002:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.307032:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127044.307322:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813568 00000100:00100000:1.0:1789127044.307329:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813568 00000100:00100000:1.0:1789127044.307370:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789127044.307379:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127044.307481:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813568:12345-0@lo:502:mount.lustre.0 Request processed in 103us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.307489:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127044.307630:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.307907:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789127044.307933:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789127044.307948:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789127044.307960:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789127044.307973:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789127044.308012:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789127044.308026:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789127044.308041:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:3.0:1789127044.308054:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:3.0:1789127044.308066:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:3.0:1789127044.308343:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:3.0:1789127044.308473:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:3.0:1789127044.308490:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:3.0:1789127044.308504:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:3.0:1789127044.308517:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:3.0:1789127044.308530:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:3.0:1789127044.308542:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:3.0:1789127044.308575:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127044.308624:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.308967:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.309057:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813696 00000100:00100000:0.0:1789127044.309064:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813696 00000100:00100000:1.0:1789127044.309335:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127044.309347:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127044.309558:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813696:12345-0@lo:502:mount.lustre.0 Request processed in 213us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.309566:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127044.309946:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.310215:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:3.0:1789127044.310228:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789127044.310871:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.310880:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.310883:0:18625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127044.310890:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99422035d800 00000020:00000080:1.0:1789127044.310893:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.310900:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.310903:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.310904:0:18625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127044.310906:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.310909:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.310910:0:18625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127044.310914:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99422035d800 00000020:00000080:1.0:1789127044.310915:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.310972:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.310977:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311419:0:18625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127044.311425:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.311428:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311430:0:18625:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127044.311434:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422035d800 00000020:00000080:1.0:1789127044.311437:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.311459:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.311462:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311463:0:18625:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127044.311465:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.311468:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311469:0:18625:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127044.311472:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422035d800 00000020:00000080:1.0:1789127044.311475:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.311490:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.311493:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311494:0:18625:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127044.311496:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.311499:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311500:0:18625:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127044.311504:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422035d800 00000020:00000080:1.0:1789127044.311506:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.311521:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.311524:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311525:0:18625:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127044.311527:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127044.311529:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311531:0:18625:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127044.311534:0:18625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422035d800 00000020:00000080:1.0:1789127044.311536:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127044.311558:0:18625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127044.311561:0:18625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127044.311562:0:18625:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789127044.311571:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:3.0:1789127044.313846:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789127044.313889:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127044.313949:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.313963:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127044.324822:0:18612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127044.324830:0:18612:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99422035d800 10000000:01000000:0.0:1789127044.324834:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99422035d800 10000000:01000000:0.0:1789127044.324839:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127044.324846:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99422035d800 from 1 10000000:01000000:0.0:1789127044.324849:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127044.324895:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.324908:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.324920:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127044.324957:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127044.325032:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.325094:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813824 00000100:00100000:0.0:1789127044.325101:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813824 00000100:00100000:0.0:1789127044.325150:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127044.325160:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:18612:x1876035276813824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127044.325174:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127044.325187:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212167200/0xa840b4da666ebcd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebcd1 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.325212:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212167200/0xa840b4da666ebcd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebcd1 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.325223:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212167200/0xa840b4da666ebcd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcd1 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.325245:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167200, rc 0) 00000100:00100000:0.0:1789127044.325282:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276813824:12345-0@lo:101:mount.lustre.0 Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.325288:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127044.325335:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.325368:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127044.325385:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.325395:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127044.327500:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789127044.327829:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127044.328052:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789127044.330770:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789127044.330816:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789127044.330836:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789127044.330856:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789127044.330876:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789127044.330896:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789127044.330932:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789127044.330955:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789127044.330972:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789127044.331007:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789127044.331031:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789127044.331050:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789127044.332772:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789127044.332814:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789127044.332831:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789127044.332846:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789127044.332862:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789127044.332877:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789127044.332892:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789127044.332906:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789127044.332919:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789127044.332930:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789127044.332957:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789127044.332971:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789127044.333425:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789127044.333455:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789127044.333476:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789127044.333508:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789127044.333523:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789127044.333632:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127044.335415:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.335471:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127044.335550:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276813952 00000100:00100000:3.0:1789127044.335560:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276813952 00000100:00100000:3.0:1789127044.335622:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127044.335632:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276813952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127044.335837:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276813952:12345-0@lo:501:mount.lustre.0 Request processed in 206us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.335846:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127044.335950:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276813952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127044.336008:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127044.336051:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127044.336082:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.336422:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814080 00000100:00100000:0.0:1789127044.336427:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814080 00000100:00100000:0.0:1789127044.336459:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127044.336466:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127044.336556:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814080:12345-0@lo:503:mount.lustre.0 Request processed in 90us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.336563:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127044.336921:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127044.337475:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127044.337542:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127044.337592:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127044.337695:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127044.346226:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814208 00000100:00100000:0.0:1789127044.346249:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814208 00000100:00100000:0.0:1789127044.346311:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127044.346322:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127044.347968:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814208:12345-0@lo:502:mount.lustre.0 Request processed in 1643us (10370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.347979:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127044.348375:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127044.348624:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789127044.348676:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789127044.348693:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789127044.348707:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789127044.348720:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789127044.348733:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789127044.348747:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789127044.348761:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789127044.348774:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789127044.348788:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789127044.348804:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789127044.348820:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789127044.348853:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789127044.348872:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789127044.348889:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789127044.348903:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789127044.348917:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789127044.348944:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789127044.348961:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789127044.348978:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789127044.348992:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789127044.349634:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789127044.349667:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789127044.349683:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789127044.349697:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789127044.349711:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789127044.349723:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789127044.349735:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789127044.349762:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789127044.349777:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789127044.349790:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789127044.349802:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789127044.349815:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789127044.349830:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789127044.349845:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789127044.349861:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789127044.349878:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789127044.349896:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789127044.349911:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789127044.349926:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789127044.349942:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789127044.349958:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789127044.349974:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789127044.349986:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789127044.350024:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789127044.350040:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789127044.351784:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789127044.351815:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789127044.351875:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127044.351963:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.352071:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127044.355562:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814336 00000100:00100000:1.0:1789127044.355580:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814336 00000100:00100000:1.0:1789127044.355661:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127044.355673:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127044.355892:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814336:12345-0@lo:502:mount.lustre.0 Request processed in 222us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.355900:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127044.362885:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.363318:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789127044.363346:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789127044.363457:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127044.363536:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.363585:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814464 00000100:00100000:3.0:1789127044.363592:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814464 00000100:00100000:3.0:1789127044.363736:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127044.363748:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127044.363861:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814464:12345-0@lo:502:mount.lustre.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.363870:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127044.375134:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127044.375185:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127044.375301:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789127044.375315:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789127044.386426:0:18632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789127044.386442:0:18632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff994102eb9a48) 00000020:00000080:1.0:1789127044.386465:0:18632:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789127044.386558:0:18632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99422035d800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789127044.386562:0:18632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99422035d800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789127044.386565:0:18632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99422035d800 3 00010000:00080000:1.0:1789127044.386598:0:18632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9942405e9800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127044.390507:0:18632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789127044.390743:0:18632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789127044.390791:0:18632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127044.390804:0:18632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa840b4da666ebce6 00000100:00080000:2.0:1789127044.390815:0:18632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127044.390821:0:18632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9942405e9800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127044.390862:0:18632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b480 x1876035276814592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127044.390893:0:18632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789127044.391123:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276814592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127044.391209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127044.391318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.391323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127044.391326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127044.391329:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127044.391412:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814592 00000100:00100000:2.0:1789127044.391422:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814592 00000100:00100000:2.0:1789127044.391464:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127044.391475:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276814592:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127044.391501:0:17877:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1789127044.391548:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa840b4da666ebced 00000004:00100000:2.0:1789127044.391563:0:17877:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127044.391599:0:17877:0:(import.c:65:import_set_state_nolock()) ffff994205dfa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127044.391828:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876035276814592:12345-0@lo:38:llog_process_th.0 Request processed in 352us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.391837:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127044.391883:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410501b480 x1876035276814592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127044.391894:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127044.391903:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789127044.391915:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789127044.391920:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127044.391923:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127044.391930:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276814592:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789127044.392386:0:18632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789127044.443468:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789127044.443520:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127044.443539:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.443553:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127044.443608:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127044.443611:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789127044.443612:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127044.443613:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127044.443614:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127044.443616:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127044.443617:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127044.443619:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127044.443620:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127044.443624:0:18612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789127044.443626:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127044.443628:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789127044.443629:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127044.443630:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127044.443631:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127044.443632:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127044.443633:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127044.443634:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127044.443635:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127044.443695:0:18612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789127044.443717:0:18612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127044.443792:0:18612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127044.443839:0:18612:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.444395:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814720 00000100:00100000:2.0:1789127044.444405:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814720 00000100:00100000:2.0:1789127044.444468:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127044.444480:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814720:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127044.444508:0:17871:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127044.444522:0:17871:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789127044.447139:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789127044.447850:0:17871:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127044.447869:0:17871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789127044.448138:0:17892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789127044.448144:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789127044.448178:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448207:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448227:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448244:0:17892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448282:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448297:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 18 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127044.448312:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276814848:0@lo:104: 00000100:00100000:3.0:1789127044.448397:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127044.448644:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127044.448693:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 18 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127044.448702:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276814976:0@lo:104: 00000100:00100000:3.0:1789127044.448726:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127044.448748:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206153780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127044.448877:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814848 00000100:00100000:1.0:1789127044.448884:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814848 00000100:00100000:1.0:1789127044.448928:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276814976 00000100:00100000:1.0:1789127044.448931:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276814976 00000100:00100000:1.0:1789127044.448946:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127044.448956:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276814848:12345-0@lo:104: 00010000:00010000:1.0:1789127044.448981:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.449035:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127044.449041:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276814848:12345-0@lo:104: Request processed in 87us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.449049:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127044.449065:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127044.449071:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276814976:12345-0@lo:104: 00010000:00010000:1.0:1789127044.449079:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127044.449106:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127044.449111:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276814976:12345-0@lo:104: Request processed in 40us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127044.449117:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127044.449364:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276814848:0@lo:104: 00000100:00100000:3.0:1789127044.449375:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276814976:0@lo:104: 00010000:00010000:3.0:1789127044.449394:0:17892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127044.449577:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:18612:x1876035276814720:12345-0@lo:253:mount.lustre.0 Request processed in 5099us (5784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.449586:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1789127044.449745:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127044.449753:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449771:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127044.449775:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449784:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127044.449791:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127044.449796:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127044.449838:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449845:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127044.449868:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449875:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2400/0xa840b4da666ebcb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcbc expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449888:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127044.449891:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449897:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127044.449900:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449916:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127044.449923:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127044.449928:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127044.449941:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449946:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127044.449952:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.449958:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ebbf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbf8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.450043:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127044.450045:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127044.450047:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127044.450053:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127044.450066:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276815104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127044.450102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.450298:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127044.450308:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276815232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127044.450333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127044.450499:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815104 00000100:00100000:0.0:1789127044.450505:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815104 00010000:00010000:0.0:1789127044.450534:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 18 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127044.450559:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815232 00000100:00100000:0.0:1789127044.450562:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815232 00010000:00010000:0.0:1789127044.450574:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 19 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127044.450589:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127044.450596:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:3639:x1876035276815104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127044.450608:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127044.450613:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 19 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.450624:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 19 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.450640:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3800/0xa840b4da666ebcbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebcb5 expref: 19 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.459575:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127044.459708:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3639:x1876035276815104:12345-0@lo:103:ldlm_bl.0 Request processed in 9105us (9599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127044.459722:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127044.459759:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127044.459772:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:3639:x1876035276815232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127044.459790:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789127044.459866:0:18612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:18612:1876035276814720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127044.459880:0:18612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789127044.459883:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127044.459885:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789127044.459886:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127044.459887:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127044.459889:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127044.459890:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127044.459891:0:18612:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127044.459893:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127044.459907:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789127044.459926:0:18612:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789127044.461073:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 17 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461114:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 17 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461137:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166000/0xa840b4da666ebbf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebbf1 expref: 17 pid: 17871 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461170:0:17863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461180:0:17863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127044.461208:0:17863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013064608s 00010000:00010000:0.0:1789127044.461214:0:17863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461223:0:17863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461237:0:17863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461244:0:17863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461251:0:17863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127044.461256:0:17863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461264:0:17863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461304:0:17863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461318:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127044.461405:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:3639:x1876035276815232:12345-0@lo:103:ldlm_bl.0 Request processed in 1636us (11069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127044.461705:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276815232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127044.461718:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276815104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127044.461804:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789127044.461862:0:17892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461872:0:17892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127044.461879:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b66c00/0xa840b4da666ebcf4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1789127044.498866:0:18612:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789127044.498874:0:18637:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789127044.498880:0:18637:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789127044.500348:0:18638:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789127044.500536:0:18612:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789127044.500925:0:18638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789127044.502425:0:18612:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789127044.502463:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789127044.504055:0:18612:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1789127044.504823:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.504899:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.504941:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815360 00000100:00100000:2.0:1789127044.504950:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815360 00000100:00100000:2.0:1789127044.504999:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127044.505009:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815360:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505083:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.505092:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127044.505130:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.505173:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815360:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789127044.505211:0:18639:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789127044.505250:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505281:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.505311:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815488 00000100:00100000:2.0:1789127044.505315:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815488 00000100:00100000:2.0:1789127044.505331:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127044.505337:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815488:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505434:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.505441:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127044.505455:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.505467:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505513:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18639:1876035276815616:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505537:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.505560:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118180 going to sleep for 11 seconds 00000040:01000000:0.0:1789127044.505746:0:18612:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1789127044.505829:0:17887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815616 00000100:00100000:2.0:1789127044.505834:0:17887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815616 00000040:00080000:0.0:1789127044.505834:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127044.505862:0:17887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127044.505867:0:17887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18639:x1876035276815616:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505903:0:17887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18639:x1876035276815616:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.505909:0:17887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789127044.505935:0:18639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410501b480 x1876035276815616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127060 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127044.505945:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18639:1876035276815616:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505976:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.505995:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127044.506010:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815744 00000100:00100000:2.0:1789127044.506018:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815744 00000100:00100000:2.0:1789127044.506034:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127044.506038:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815744:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127044.506078:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18639:x1876035276815744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 39us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127044.506084:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127044.506096:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127044.506106:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18639:1876035276815744:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789127044.506138:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127044.512605:0:18638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127044.513617:0:18638:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789127044.514863:0:18639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789127044.514934:0:18639:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789127044.514939:0:18639:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:0.0:1789127044.517156:0:18612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789127044.517758:0:18612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789127044.517796:0:18612:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789127044.517942:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789127044.525579:0:18612:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1789127044.534516:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789127044.548460:0:18612:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789127044.548501:0:18612:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb305419bb988 00100000:10000000:1.0:1789127044.548510:0:18612:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789127044.550379:0:18612:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127044.550414:0:18612:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127044.550433:0:18612:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789127044.550458:0:18612:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789127044.556289:0:18612:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127044.556540:0:18612:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789127044.595053:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127045.176810:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127045.421159:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127045.619483:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 10000000:01000000:0.0:1789127045.635757:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127045.635764:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422035d800 from 8 10000000:01000000:0.0:1789127045.635768:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127045.635823:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127045.635835:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127045.635847:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127045.635874:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276815872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127045.635962:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127045.636010:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127045.636091:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276815872 00000100:00100000:3.0:1789127045.636098:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276815872 00000100:00100000:3.0:1789127045.636160:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127045.636171:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:17874:x1876035276815872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127045.636184:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127045.636199:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebcfb expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127045.636240:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127045.636253:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127045.636263:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67600, rc 0) 00000100:00100000:3.0:1789127045.636311:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276815872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127045.636319:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127045.637736:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276815872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127045.637761:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127045.637774:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127045.637912:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127045.637966:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127045.638008:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127045.639089:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816000 00000100:00100000:1.0:1789127045.639098:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816000 00000100:00100000:1.0:1789127045.639158:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127045.639168:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276816000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789127045.639189:0:17871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789127045.639207:0:17871:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789127045.639210:0:17871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789127045.639325:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276816000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127045.639333:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127045.639377:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127045.639424:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127045.639432:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127045.639448:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127045.639460:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127045.639462:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9941050e6800 from 8 10000000:01000000:1.0:1789127045.639464:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127045.639490:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127045.639498:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127045.639507:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127045.639523:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127045.639552:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127045.639575:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421826f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127045.643310:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816128 00000100:00100000:0.0:1789127045.643326:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816128 00000100:00100000:0.0:1789127045.643387:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127045.643399:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276816128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127045.643417:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127045.643438:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd09 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127045.643470:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 18 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127045.643482:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 18 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127045.643502:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166e00, rc 0) 00000100:00100000:0.0:1789127045.643593:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276816128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127045.643601:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127045.643760:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127045.643780:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127045.643798:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127045.643866:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127045.643906:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127045.643946:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213ca79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127045.644036:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816256 00000100:00100000:1.0:1789127045.644042:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816256 00000100:00100000:1.0:1789127045.644067:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127045.644074:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276816256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789127045.644089:0:17871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789127045.644106:0:17871:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789127045.644109:0:17871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789127045.644192:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276816256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127045.644200:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127045.644252:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276816256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127045.644302:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127045.644309:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127045.644317:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127046.191365:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127046.451948:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127046.641291:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127047.215677:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127047.668403:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:1.0:1789127048.237082:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127048.684395:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00010000:00010000:1.0:1789127049.262505:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127049.389674:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127049.389695:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276816384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127049.389765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.389824:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816384 00000100:00100000:2.0:1789127049.389838:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816384 00000100:00100000:2.0:1789127049.389882:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127049.389891:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276816384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127049.389924:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127049.389966:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276816384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127049.389973:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127049.390017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276816384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127049.708719:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 0 seconds 00000100:00080000:2.0:1789127049.910234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127049.910240:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789127049.910244:0:8:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127049.910256:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994104282800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127049.910284:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b480 x1876035276816640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127049.910302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127049.910306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127049.910309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127049.910312:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127049.910334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127049.910337:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127049.910340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127049.910343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127049.910372:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276817024:0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.910497:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127049.910503:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276816512:0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.910561:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276816640:0@lo:38:kworker.0 00000100:00100000:2.0:1789127049.910591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.910616:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276816768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.910678:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127049.910683:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276816896:0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127049.910735:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817024 00000100:00100000:2.0:1789127049.910742:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817024 00000100:00100000:2.0:1789127049.910782:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816768 00000100:00100000:2.0:1789127049.910785:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816768 00000100:00100000:2.0:1789127049.910801:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127049.910809:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276817024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910859:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276817024:12345-0@lo:400:kworker.0 Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127049.910867:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127049.910883:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127049.910889:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276816768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.910917:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276816768:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127049.910923:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127049.910954:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816512 00000100:00100000:2.0:1789127049.910963:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816512 00000100:00100000:2.0:1789127049.910990:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127049.910996:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3641:x1876035276816512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.911024:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3641:x1876035276816512:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127049.911031:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127049.911056:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816640 00000100:00100000:2.0:1789127049.911060:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816640 00000100:00100000:2.0:1789127049.911081:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276816896 00000100:00100000:2.0:1789127049.911084:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276816896 00000100:00100000:2.0:1789127049.911098:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127049.911104:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276816640:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789127049.911125:0:17881:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1789127049.911157:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebd17 00000004:00100000:2.0:1789127049.911171:0:17881:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789127049.911176:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1789127049.911281:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994105018f00 x1876035276816768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127049.911294:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276816768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127049.911316:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276816512:0@lo:400:kworker.0 00010000:00080000:2.0:1789127049.911325:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99410501ad00 x1876035276817024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127049.911333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276817024:0@lo:400:kworker.0 00000100:00080000:1.0:1789127049.922441:0:17881:0:(import.c:65:import_set_state_nolock()) ffff9942064b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127049.922537:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276816640:12345-0@lo:38:kworker.0 Request processed in 11429us (11942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127049.922551:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127049.922582:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127049.922593:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276816896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127049.922635:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276816896:12345-0@lo:400:kworker.0 Request processed in 46us (11929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127049.922641:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789127049.922701:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789127049.922710:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789127049.922715:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789127049.922718:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789127049.922738:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fe4987e7): req@ffff9941043e5a40 x1876035276809600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127049.922756:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276816640:0@lo:38:kworker.0 00000100:00100000:1.0:1789127049.922828:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127049.922849:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941010c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127049.922862:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276809600 00000100:00100000:1.0:1789127049.922868:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276809600 00000100:00100000:1.0:1789127049.922899:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127049.922905:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276809600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.922960:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276809600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127049.922966:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127049.922989:0:17920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17920:1876035276809600:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789127049.923016:0:17920:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789127049.923051:0:17920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17920:1876035276817152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.923092:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127049.923114:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff994207e1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127049.923124:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817152 00000100:00100000:1.0:1789127049.923127:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817152 00000100:00100000:1.0:1789127049.923143:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127049.923148:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276817152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.923245:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276817152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127049.923252:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127049.923280:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276816896:0@lo:400:kworker.0 00000100:00100000:1.0:1789127049.923302:0:17920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17920:1876035276817152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.923358:0:17920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17920:1876035276817280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.923380:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127049.923401:0:17920:0:(client.c:2715:ptlrpc_set_wait()) set ffff994207e1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127049.923413:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817280 00000100:00100000:1.0:1789127049.923416:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817280 00000100:00100000:1.0:1789127049.923431:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127049.923437:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276817280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789127049.923476:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17920:x1876035276817280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127049.923483:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127049.923503:0:17920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17920:1876035276817280:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789127049.923536:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127049.925868:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276817408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127049.925931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127049.925983:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817408 00000100:00100000:3.0:1789127049.925989:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817408 00000100:00100000:3.0:1789127049.926027:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127049.926035:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276817408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127049.927169:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127049.927310:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276817408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1273us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127049.927319:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127049.928016:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276817408:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789127049.934688:0:17920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127049.934762:0:17920:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1789127049.934767:0:17920:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1789127050.056433:0:18883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127050.323578:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127051.045217:0:18935:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127051.045415:0:18935:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127051.307033:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127052.223986:0:18985:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127052.224222:0:18985:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127052.331151:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127052.715332:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1789127053.308644:0:19033:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd4ad5310 20000000:00000080:0.0:1789127053.308776:0:19033:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994205d85800 uarg=0000000000000000 20000000:01000000:0.0:1789127053.308812:0:19033:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789127053.308819:0:19033:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789127053.308823:0:19033:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789127053.309535:0:19034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:0.0:1789127053.309812:0:19033:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789127053.320881:0:19033:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789127053.324228:0:19033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324253:0:19033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324261:0:19033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 17 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324269:0:19033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324620:0:19033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 17 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324757:0:19033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 17 pid: 17871 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127053.324772:0:19033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19033:1876035276817536:0@lo:104: 00000100:00100000:1.0:1789127053.324837:0:19033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127053.324938:0:19033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127053.324946:0:19033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127053.324965:0:19033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19033:1876035276817664:0@lo:104: 00000100:00100000:1.0:1789127053.324986:0:19033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127053.325181:0:19033:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127053.325247:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817536 00000100:00100000:0.0:1789127053.325256:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817536 00000100:00100000:0.0:1789127053.325473:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817664 00000100:00100000:0.0:1789127053.325478:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817664 00000100:00100000:0.0:1789127053.325498:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127053.325508:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:19033:x1876035276817536:12345-0@lo:104: 00010000:00010000:0.0:1789127053.325523:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325612:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127053.325619:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:19033:x1876035276817536:12345-0@lo:104: Request processed in 112us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127053.325626:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127053.325675:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127053.325682:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:19033:x1876035276817664:12345-0@lo:104: 00010000:00010000:0.0:1789127053.325691:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325726:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127053.325731:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:19033:x1876035276817664:12345-0@lo:104: Request processed in 50us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127053.325737:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789127053.325753:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127053.325759:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325767:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127053.325771:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325779:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127053.325785:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127053.325790:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127053.325819:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325825:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127053.325844:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325860:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66600/0xa840b4da666ebcc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebcca expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325872:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127053.325875:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325880:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127053.325882:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325888:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127053.325893:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127053.325898:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127053.325910:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325915:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127053.325922:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325929:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104396600/0xa840b4da666ebbc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebbc7 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.325944:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127053.326076:0:19033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19033:1876035276817536:0@lo:104: 00000100:00100000:1.0:1789127053.326085:0:19033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19033:1876035276817664:0@lo:104: 00010000:00010000:1.0:1789127053.326106:0:19033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.326251:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127053.326286:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127053.326287:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127053.326432:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276817792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127053.326471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127053.326548:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127053.326555:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276817920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127053.326577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127053.328813:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817792 00000100:00100000:3.0:1789127053.328826:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817792 00010000:00010000:3.0:1789127053.328882:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 18 pid: 17871 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127053.328927:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276817920 00000100:00100000:3.0:1789127053.328931:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276817920 00010000:00010000:3.0:1789127053.328944:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 19 pid: 17872 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127053.328970:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127053.328979:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:3639:x1876035276817792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127053.328993:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127053.328999:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 19 pid: 17871 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329011:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 19 pid: 17871 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329039:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104396c00/0xa840b4da666ebcca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebcc3 expref: 19 pid: 17871 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329056:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127053.329167:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3639:x1876035276817792:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127053.329183:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127053.329200:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127053.329207:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:3639:x1876035276817920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127053.329214:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127053.329218:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329236:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329247:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b66e00/0xa840b4da666ebbc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebbc0 expref: 17 pid: 17872 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329259:0:17862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329267:0:17862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329283:0:17862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329290:0:17862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329314:0:17862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329321:0:17862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329327:0:17862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127053.329332:0:17862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329342:0:17862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329369:0:17862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127053.329379:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127053.329405:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:3639:x1876035276817920:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127053.329411:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789127053.329716:0:19033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.329726:0:19033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127053.329733:0:19033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104396000/0xa840b4da666ebd1e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127053.335942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276817792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127053.335987:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276817920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127053.357616:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127054.378766:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127054.506909:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127054.506932:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276818048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127054.507000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127054.507086:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818048 00000100:00100000:3.0:1789127054.507096:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818048 00000100:00100000:3.0:1789127054.507155:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127054.507176:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276818048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127054.507210:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127054.507261:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276818048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127054.507269:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127054.507316:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276818048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127055.019832:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276818176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127055.019902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.019966:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818176 00000100:00100000:2.0:1789127055.019974:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818176 00000100:00100000:2.0:1789127055.020020:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127055.020029:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276818176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127055.020064:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127055.020112:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276818176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.020120:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789127055.020278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.020291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127055.020294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.020297:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127055.020319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.020322:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127055.020325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.020327:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127055.020349:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276818304:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127055.020412:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127055.020418:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276818432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127055.020469:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818304 00000100:00100000:0.0:1789127055.020473:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818304 00000100:00100000:0.0:1789127055.020501:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127055.020508:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:3639:x1876035276818304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020544:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:3639:x1876035276818304:12345-0@lo:400:kworker.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127055.020550:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127055.020578:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818432 00000100:00100000:0.0:1789127055.020582:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818432 00000100:00100000:0.0:1789127055.020606:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127055.020612:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276818432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020639:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276818432:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127055.020645:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127055.020687:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276818560:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127055.020730:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127055.020735:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276818688:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127055.020781:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818688 00000100:00100000:0.0:1789127055.020785:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818688 00000100:00100000:0.0:1789127055.020805:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127055.020811:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276818688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020849:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276818688:12345-0@lo:400:kworker.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127055.020856:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789127055.020887:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99410488c3c0 x1876035276818688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127055.020900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276818688:0@lo:400:kworker.0 00010000:00080000:0.0:1789127055.020926:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99410488e580 x1876035276818432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127055.020934:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276818432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020940:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276818304:0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.020958:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276818560 00000100:00100000:0.0:1789127055.020961:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276818560 00000100:00100000:0.0:1789127055.020976:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127055.020983:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276818560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127055.021017:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276818560:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127055.021023:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127055.021045:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276818560:0@lo:400:kworker.0 00000100:00100000:1.0:1789127055.021201:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127044/real 1789127044] req@ffff99410480a940 x1876035276812800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021219:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410480a940 x1876035276812800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021236:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127044/real 1789127044] req@ffff994104809e00 x1876035276812672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021247:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104809e00 x1876035276812672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021254:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127040/real 1789127040] req@ffff994104809a40 x1876035276810624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021264:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104809a40 x1876035276810624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021271:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127040/real 1789127040] req@ffff994104808000 x1876035276810752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127055.021293:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104808000 x1876035276810752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127055.021305:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127055.021314:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127055.021317:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812800:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789127055.021321:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127055.021326:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127055.021328:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276812672:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789127055.021332:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127055.021335:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127055.021337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810624:0@lo:8:kworker.0 00000100:00080000:1.0:1789127055.021347:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127055.021351:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127055.021354:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276810752:0@lo:8:kworker.0 00000100:00080000:0.0:1789127055.021627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.021632:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789127055.021635:0:36:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127055.021639:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1789127055.021643:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789127055.021683:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9941032b3800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127055.021708:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488f840 x1876035276818816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127055.021725:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.021728:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127055.021729:0:36:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127055.021733:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1789127055.021735:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789127055.021739:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422043b000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127055.021749:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488c780 x1876035276818944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127055.021758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.021761:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789127055.021762:0:36:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127055.021765:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1789127055.021767:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127055.021770:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99423d063800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127055.021779:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488e580 x1876035276819072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127055.021787:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127055.021790:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127055.021792:0:36:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127055.021794:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1789127055.021796:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127055.021799:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99423d039000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127055.021817:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488c3c0 x1876035276819200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127055.021890:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276818176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127055.021967:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276818816:0@lo:8:kworker.0 00000400:00000100:1.0:1789127055.021998:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276818816 offset 0 length 520: 4 00000100:00100000:1.0:1789127055.022023:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276818944:0@lo:8:kworker.0 00000400:00000100:1.0:1789127055.022040:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276818944 offset 0 length 520: 4 00000100:00100000:1.0:1789127055.022051:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276819072:0@lo:8:kworker.0 00000400:00000100:1.0:1789127055.022064:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276819072 offset 0 length 520: 4 00000100:00100000:1.0:1789127055.022074:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276819200:0@lo:8:kworker.0 00000400:00000100:1.0:1789127055.022086:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276819200 offset 0 length 520: 4 10000000:01000000:0.0:1789127055.215930:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127055.215938:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422035d800 from 19 10000000:01000000:0.0:1789127055.215943:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127055.216009:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127055.216021:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127055.216034:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127055.216059:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127055.216128:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127055.216188:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.216306:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819328 00000100:00100000:2.0:1789127055.216315:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819328 00000100:00100000:2.0:1789127055.216380:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127055.216390:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+16:17874:x1876035276819328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127055.216404:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127055.216418:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd25 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.216445:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.216455:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 17 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.216478:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:2.0:1789127055.216526:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.216533:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127055.216581:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127055.216597:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.216606:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127055.216692:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.216716:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.216736:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.216748:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819456 00000100:00100000:2.0:1789127055.216753:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819456 00000100:00100000:2.0:1789127055.216776:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127055.216783:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.216888:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.216894:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127055.216923:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.216950:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.217003:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.217022:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.217033:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819584 00000100:00100000:2.0:1789127055.217036:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819584 00000100:00100000:2.0:1789127055.217056:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127055.217061:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.217133:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.217139:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127055.217184:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127055.217822:0:19102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127055.217873:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127055.217892:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127055.217899:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.217908:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127055.217917:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127055.217919:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9941050e6800 from 19 10000000:01000000:2.0:1789127055.217921:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127055.217944:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.217952:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.217960:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127055.217986:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218016:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.218038:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.218052:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819712 00000100:00100000:2.0:1789127055.218056:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819712 00000100:00100000:2.0:1789127055.218080:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127055.218087:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+17:17874:x1876035276819712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127055.218096:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127055.218105:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd33 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.218125:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.218134:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 18 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.218142:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2a00, rc 0) 00000100:00100000:2.0:1789127055.218183:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276819712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.218189:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127055.218223:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127055.218234:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127055.218242:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127055.218288:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218312:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.218324:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.218335:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819840 00000100:00100000:2.0:1789127055.218338:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819840 00000100:00100000:2.0:1789127055.218356:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127055.218361:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276819840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218431:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276819840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.218437:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127055.218464:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218486:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218520:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127055.218532:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127055.218543:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276819968 00000100:00100000:2.0:1789127055.218546:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276819968 00000100:00100000:2.0:1789127055.218565:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127055.218570:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276819968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127055.218632:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:17874:x1876035276819968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127055.218639:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127055.218702:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276819968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127055.230262:0:19103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789127055.230795:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789127055.230824:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127055.230836:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127055.230848:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127055.402781:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127055.533606:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789127056.429340:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127056.686256:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127057.451354:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127058.475733:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127059.498918:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127059.626992:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127059.627044:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276820096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127059.627151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127059.627231:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820096 00000100:00100000:2.0:1789127059.627239:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820096 00000100:00100000:2.0:1789127059.627290:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127059.627301:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276820096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127059.627356:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127059.627406:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276820096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127059.627414:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127059.627476:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276820096:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789127060.138971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127060.138981:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127060.138984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127060.138988:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127060.139009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127060.139012:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127060.139014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127060.139025:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127060.139066:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276820352:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139243:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276820608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127060.139386:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127060.139393:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276820224:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127060.139444:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276820736:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127060.139504:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820608 00000100:00100000:3.0:1789127060.139512:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820608 00000100:00100000:3.0:1789127060.139564:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127060.139573:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276820608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139633:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276820608:12345-0@lo:400:kworker.0 Request processed in 60us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127060.139641:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127060.139706:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820224 00000100:00100000:3.0:1789127060.139710:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820224 00000100:00100000:3.0:1789127060.139734:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127060.139740:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3639:x1876035276820224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139767:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:3639:x1876035276820224:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127060.139773:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127060.139944:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276820224:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.139956:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276820608:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.140001:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276820480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.140028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127060.140069:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820736 00000100:00100000:3.0:1789127060.140072:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820736 00000100:00100000:3.0:1789127060.140097:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820480 00000100:00100000:3.0:1789127060.140107:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820480 00000100:00100000:0.0:1789127060.140432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127060.140469:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127060.140478:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276820736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127060.140518:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276820736:12345-0@lo:400:kworker.0 Request processed in 42us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127060.140525:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789127060.140561:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994219ec7840 x1876035276820736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127060.140573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276820736:0@lo:400:kworker.0 00000100:00100000:3.0:1789127060.140748:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127060.140757:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276820480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127060.141005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276820864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127060.141040:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127060.141070:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820352 00000100:00100000:0.0:1789127060.141074:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820352 00000100:00100000:0.0:1789127060.141095:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820864 00000100:00100000:0.0:1789127060.141097:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820864 00000100:00100000:0.0:1789127060.141109:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127060.141756:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276820480:12345-0@lo:400:kworker.0 Request processed in 997us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127060.141767:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789127060.142077:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994219ec5a40 x1876035276820480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127060.142090:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276820480:0@lo:400:kworker.0 00000100:00100000:0.0:1789127060.142310:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276820352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127060.142460:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276820352:12345-0@lo:400:kworker.0 Request processed in 1343us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127060.142469:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127060.142491:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127060.142500:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276820864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127060.142533:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789127060.142590:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276820864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127060.142598:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127060.142757:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276820864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127060.142769:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276820352:0@lo:400:kworker.0 00010000:00010000:0.0:1789127060.525819:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789127061.176266:0:19381:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127061.176270:0:19381:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789127061.176271:0:19381:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789127061.176407:0:19381:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9942064a1800 00000020:01000004:0.0:1789127061.176420:0:19381:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789127061.176433:0:19381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789127061.176445:0:19381:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99423d003490) 00000020:00000080:0.0:1789127061.176460:0:19381:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789127061.274826:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127061.280212:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789127061.282315:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127061.283752:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789127061.284855:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789127061.285548:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789127061.288923:0:19381:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789127061.291850:0:19381:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127061.292040:0:19381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789127061.292053:0:19381:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127061.292065:0:19381:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ebd48 00000020:01000004:2.0:1789127061.292071:0:19381:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789127061.292094:0:19381:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127061.292097:0:19381:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127061.292103:0:19381:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789127061.292108:0:19381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789127061.292131:0:19381:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9942366b8000) 00000020:00000080:2.0:1789127061.292149:0:19381:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789127061.293404:0:19381:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127061.293611:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789127061.293618:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789127061.304760:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127061.304774:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789127061.305268:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127061.305274:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789127061.307478:0:19381:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127061.308013:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127061.308021:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789127061.310768:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127061.310780:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789127061.328558:0:19381:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127061.329022:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127061.329027:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789127061.330541:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127061.330552:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789127061.332846:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789127061.332869:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789127061.335620:0:19381:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127061.335842:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789127061.335848:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789127061.336937:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127061.336947:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789127061.363439:0:19381:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127061.363739:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789127061.363747:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789127061.366785:0:19381:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789127061.366804:0:19381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789127061.367764:0:19381:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789127061.367791:0:19381:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789127061.367798:0:19381:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789127061.387247:0:19381:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127061.387304:0:19381:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789127061.387308:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127061.387310:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127061.387311:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127061.387313:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127061.387314:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127061.387315:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127061.387317:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127061.387319:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127061.387320:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127061.387324:0:19381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789127061.387326:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127061.387327:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127061.387328:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127061.387329:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127061.387330:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127061.387331:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127061.387333:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127061.387334:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127061.387335:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127061.387363:0:19381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789127061.387385:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276820992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127061.387462:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.387515:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230ba3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.387630:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276820992 00000100:00100000:0.0:1789127061.387640:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276820992 00000100:00100000:0.0:1789127061.387777:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127061.387789:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:19381:x1876035276820992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127061.387838:0:17870:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789127061.387841:0:17870:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789127061.387845:0:17870:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789127061.390168:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:19381:x1876035276820992:12345-0@lo:253:mount.lustre.0 Request processed in 2373us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.390182:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789127061.390285:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276820992:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127061.390300:0:19381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789127061.390303:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127061.390305:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127061.390307:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127061.390308:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127061.390309:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127061.390310:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127061.390311:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127061.390313:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127061.390314:0:19381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789127061.390335:0:19381:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9942064a1800 from lustre-OST0000 10000000:01000000:1.0:1789127061.390399:0:19381:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789127061.390402:0:19381:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789127061.390410:0:19381:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994103ec8000 local copy 00010000:00010000:1.0:1789127061.390422:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127061.390522:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127061.390561:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.393946:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.395690:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821120 00000100:00100000:3.0:1789127061.395702:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821120 00000100:00100000:2.0:1789127061.395973:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127061.395986:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:19381:x1876035276821120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127061.396514:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:19381:x1876035276821120:12345-0@lo:501:mount.lustre.0 Request processed in 530us (5951us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127061.396524:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789127061.396614:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127061.396637:0:19381:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789127061.396693:0:19381:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789127061.396703:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.396714:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127061.396742:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9942064a1800 10000000:01000000:1.0:1789127061.396747:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127061.396753:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789127061.396756:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127061.396760:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789127061.396764:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127061.396798:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.396806:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.396844:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127061.396864:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127061.396902:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.396935:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.397189:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821248 00000100:00100000:0.0:1789127061.397194:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821248 00000100:00100000:0.0:1789127061.397356:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127061.397368:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+18:19381:x1876035276821248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127061.397379:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127061.397392:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166800/0xa840b4da666ebd5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd56 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.397416:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166800/0xa840b4da666ebd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd56 expref: 19 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.397427:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166800/0xa840b4da666ebd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd56 expref: 19 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.397435:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166800, rc 0) 00000100:00100000:0.0:1789127061.397470:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821248:12345-0@lo:101:mount.lustre.0 Request processed in 106us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.397476:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127061.397639:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127061.397755:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.397763:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127061.399493:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789127061.400448:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127061.403564:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789127061.403617:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789127061.403630:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789127061.403784:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789127061.403803:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789127061.403882:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789127061.403917:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789127061.403924:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789127061.404220:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127061.404526:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.404613:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.404717:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821376 00000100:00100000:0.0:1789127061.404725:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821376 00000100:00100000:0.0:1789127061.404771:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127061.404780:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127061.405231:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821376:12345-0@lo:501:mount.lustre.0 Request processed in 451us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.405250:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127061.405506:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127061.405550:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127061.405593:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.405695:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127061.405807:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821504 00000100:00100000:1.0:1789127061.405812:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821504 00000100:00100000:1.0:1789127061.405952:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789127061.405961:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127061.407084:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821504:12345-0@lo:503:mount.lustre.0 Request processed in 1061us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127061.407227:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127061.407378:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127061.407872:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127061.407958:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127061.408006:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.408318:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff99421826f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.408389:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821632 00000100:00100000:0.0:1789127061.408395:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821632 00000100:00100000:0.0:1789127061.408438:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127061.408448:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127061.408976:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821632:12345-0@lo:502:mount.lustre.0 Request processed in 529us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.408983:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127061.409135:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127061.409469:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789127061.409500:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789127061.409517:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789127061.409532:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789127061.409548:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789127061.409564:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789127061.409579:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789127061.409592:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789127061.409607:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789127061.409634:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789127061.409694:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789127061.409713:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789127061.409747:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127061.410037:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127061.410086:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.410130:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821760 00000100:00100000:3.0:1789127061.410137:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821760 00000100:00100000:3.0:1789127061.410388:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789127061.410399:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127061.410519:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821760:12345-0@lo:502:mount.lustre.0 Request processed in 121us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.410527:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789127061.410748:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127061.410810:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789127061.410832:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789127061.412124:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127061.412134:0:19398:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789127061.412141:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.412143:0:19398:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789127061.412149:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127061.412234:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9942290f3490) 00000020:00000080:3.0:1789127061.412321:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127061.412328:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127061.412411:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942064a1800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789127061.412420:0:19398:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127061.412427:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ebd6b 00010000:00010000:2.0:1789127061.418444:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789127061.418980:0:19398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789127061.424372:0:19398:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789127061.427803:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789127061.427907:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.427914:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427917:0:19398:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789127061.427921:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127061.427924:0:19398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789127061.427926:0:19398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127061.427927:0:19398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127061.427929:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127061.427939:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427941:0:19398:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127061.427944:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.427948:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427950:0:19398:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127061.427953:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127061.427955:0:19398:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789127061.427957:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.427959:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427960:0:19398:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789127061.427963:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.427965:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427966:0:19398:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127061.427970:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789127061.427992:0:19398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.427995:0:19398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.427996:0:19398:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789127061.427999:0:19398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789127061.432054:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789127061.432248:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789127061.432270:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.432283:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127061.432291:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9942064a1800 from 1 10000000:01000000:2.0:1789127061.432294:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127061.432336:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.432358:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.432370:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127061.432397:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127061.432470:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127061.432518:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127061.432672:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276821888 00000100:00100000:1.0:1789127061.432680:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276821888 00000100:00100000:1.0:1789127061.432733:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789127061.432744:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:19381:x1876035276821888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127061.432759:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127061.432772:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd72 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.432799:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 20 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.432811:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 20 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.432842:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397200, rc 0) 00000100:00100000:1.0:1789127061.432887:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276821888:12345-0@lo:101:mount.lustre.0 Request processed in 144us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127061.432894:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127061.433359:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276821888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127061.433377:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.433388:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127061.434609:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789127061.436319:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127061.436511:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789127061.436535:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789127061.436553:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789127061.436559:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789127061.436641:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127061.436729:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127061.436781:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127061.437202:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822016 00000100:00100000:1.0:1789127061.437211:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822016 00000100:00100000:1.0:1789127061.437405:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127061.437427:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127061.437559:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822016:12345-0@lo:501:mount.lustre.0 Request processed in 136us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127061.437567:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127061.437694:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127061.437733:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127061.437780:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.437803:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127061.438283:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822144 00000100:00100000:2.0:1789127061.438289:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822144 00000100:00100000:2.0:1789127061.438334:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127061.438342:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127061.438636:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822144:12345-0@lo:503:mount.lustre.0 Request processed in 294us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127061.438645:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127061.438760:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822144:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127061.439919:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127061.440000:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127061.440393:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.440549:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127061.445760:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822272 00000100:00100000:1.0:1789127061.445776:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822272 00000100:00100000:1.0:1789127061.448102:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127061.448133:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127061.448568:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822272:12345-0@lo:502:mount.lustre.0 Request processed in 452us (8174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127061.448576:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127061.449707:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127061.449982:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789127061.450034:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789127061.450051:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789127061.450066:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789127061.450099:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789127061.450127:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789127061.450144:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789127061.450414:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789127061.450436:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789127061.450448:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789127061.450459:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:3.0:1789127061.450471:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:3.0:1789127061.450514:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:3.0:1789127061.450530:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:3.0:1789127061.450542:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:3.0:1789127061.450556:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:3.0:1789127061.450571:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:3.0:1789127061.450613:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127061.450713:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.450760:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.451273:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822400 00000100:00100000:0.0:1789127061.451281:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822400 00000100:00100000:0.0:1789127061.451337:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127061.451358:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127061.451488:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822400:12345-0@lo:502:mount.lustre.0 Request processed in 140us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.451498:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789127061.451808:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127061.451884:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:3.0:1789127061.451897:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789127061.453529:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.453539:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.453542:0:19402:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127061.453548:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9942064a1800 00000020:00000080:3.0:1789127061.453551:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.453559:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.453562:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.453563:0:19402:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789127061.453565:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.453574:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.453576:0:19402:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789127061.453579:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9942064a1800 00000020:00000080:3.0:1789127061.453581:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.453693:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.453698:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.453700:0:19402:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789127061.453703:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.453706:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.453708:0:19402:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127061.453712:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942064a1800 00000020:00000080:3.0:1789127061.453714:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.458372:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.458387:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458389:0:19402:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127061.458393:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.458397:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458398:0:19402:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127061.458402:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942064a1800 00000020:00000080:3.0:1789127061.458405:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.458448:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.458451:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458453:0:19402:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127061.458455:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.458458:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458459:0:19402:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127061.458462:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942064a1800 00000020:00000080:3.0:1789127061.458465:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.458482:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.458485:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458486:0:19402:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127061.458489:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127061.458491:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458504:0:19402:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789127061.458509:0:19402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942064a1800 00000020:00000080:3.0:1789127061.458511:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127061.458549:0:19402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127061.458552:0:19402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127061.458553:0:19402:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789127061.458556:0:19402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:1.0:1789127061.462856:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789127061.462904:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127061.462927:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.462940:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127061.466221:0:19381:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789127061.466225:0:19381:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9942064a1800 10000000:01000000:1.0:1789127061.466228:0:19381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9942064a1800 10000000:01000000:1.0:1789127061.466232:0:19381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127061.469140:0:19381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9942064a1800 from 1 10000000:01000000:1.0:1789127061.469144:0:19381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127061.469204:0:19381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.469217:0:19381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.469229:0:19381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127061.469265:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127061.469340:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.473717:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127061.473963:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822528 00000100:00100000:0.0:1789127061.473975:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822528 00000100:00100000:0.0:1789127061.474058:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127061.474070:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:19381:x1876035276822528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127061.474089:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127061.474110:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212167800/0xa840b4da666ebd87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebd80 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.474151:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212167800/0xa840b4da666ebd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebd80 expref: 21 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.474179:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212167800/0xa840b4da666ebd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd80 expref: 21 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127061.474190:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167800, rc 0) 00000100:00100000:0.0:1789127061.476223:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822528:12345-0@lo:101:mount.lustre.0 Request processed in 2147us (6876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.476234:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789127061.476693:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127061.476720:0:19381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.476734:0:19381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127061.481932:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789127061.482779:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127061.485032:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789127061.485081:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789127061.485098:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789127061.485122:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789127061.485139:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789127061.485154:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789127061.485168:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789127061.485182:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789127061.485197:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789127061.485227:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789127061.485259:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789127061.485275:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789127061.485289:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789127061.485305:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789127061.485321:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789127061.485334:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789127061.485364:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789127061.485383:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789127061.485400:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789127061.485417:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789127061.485431:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789127061.485445:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789127061.485460:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789127061.485473:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789127061.485487:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789127061.485514:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789127061.485529:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789127061.485541:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789127061.485589:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789127061.485607:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789127061.485621:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789127061.485635:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789127061.485668:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789127061.485686:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789127061.485715:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789127061.485728:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789127061.485742:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789127061.485766:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789127061.485772:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789127061.485884:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127061.485965:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.486012:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.487211:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822656 00000100:00100000:3.0:1789127061.487223:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822656 00000100:00100000:3.0:1789127061.487281:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789127061.487292:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127061.487453:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822656:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.487464:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789127061.490279:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127061.490618:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127061.490731:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.493924:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127061.494321:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822784 00000100:00100000:2.0:1789127061.494332:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822784 00000100:00100000:2.0:1789127061.494442:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127061.494454:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127061.494603:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822784:12345-0@lo:503:mount.lustre.0 Request processed in 150us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127061.494612:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789127061.494941:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127061.496475:0:19381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127061.496570:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127061.496644:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.496708:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.496727:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276822912 00000100:00100000:3.0:1789127061.496736:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276822912 00000100:00100000:3.0:1789127061.496790:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127061.496909:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127061.497089:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276822912:12345-0@lo:502:mount.lustre.0 Request processed in 222us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127061.497097:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789127061.497638:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276822912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127061.498524:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789127061.498574:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789127061.498592:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789127061.498607:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789127061.498621:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789127061.498634:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789127061.498671:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789127061.498689:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789127061.498703:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789127061.498728:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789127061.498741:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789127061.498753:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789127061.498764:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789127061.498777:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789127061.498791:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789127061.498803:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789127061.498816:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789127061.498855:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789127061.498872:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789127061.498885:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789127061.498899:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789127061.498913:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789127061.498927:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789127061.498940:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789127061.498953:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789127061.498966:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789127061.498980:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789127061.498993:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789127061.499005:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789127061.499030:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789127061.499047:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789127061.499060:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789127061.499074:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789127061.499101:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789127061.499130:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789127061.499146:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789127061.499159:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789127061.499173:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789127061.499186:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789127061.499199:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789127061.499212:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789127061.499226:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789127061.499560:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789127061.499577:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789127061.499589:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789127061.499601:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789127061.499614:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789127061.499629:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789127061.499712:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276823040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127061.499783:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.499836:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823040 00000100:00100000:3.0:1789127061.499843:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823040 00000100:00100000:3.0:1789127061.499901:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127061.499913:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276823040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127061.499956:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.500095:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276823040:12345-0@lo:502:mount.lustre.0 Request processed in 184us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.500104:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789127061.500197:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276823040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127061.500366:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789127061.500398:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789127061.500426:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276823168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127061.500482:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.500555:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127061.505227:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823168 00000100:00100000:2.0:1789127061.505315:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823168 00000100:00100000:2.0:1789127061.505388:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789127061.505400:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276823168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127061.505767:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276823168:12345-0@lo:502:mount.lustre.0 Request processed in 369us (5284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127061.505776:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789127061.506562:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276823168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127061.506723:0:19381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789127061.506737:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789127061.509446:0:19409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127061.509462:0:19409:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99423d000000) 00000020:00000080:0.0:1789127061.509485:0:19409:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789127061.509834:0:19409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942064a1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127061.509839:0:19409:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9942064a1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127061.509842:0:19409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942064a1800 3 00010000:00080000:0.0:1789127061.509874:0:19409:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941030ce800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789127061.511473:0:19409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789127061.511719:0:19409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789127061.511755:0:19409:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127061.511767:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa840b4da666ebd95 00000100:00080000:0.0:1789127061.511777:0:19409:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127061.511783:0:19409:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9941030ce800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127061.511820:0:19409:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ec7480 x1876035276823296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127061.511864:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276823296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127061.511931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127061.511998:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823296 00000100:00100000:0.0:1789127061.512005:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823296 00000100:00100000:0.0:1789127061.512034:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127061.512045:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276823296:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789127061.512069:0:17876:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1789127061.512097:0:17876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa840b4da666ebd9c 00000004:00100000:0.0:1789127061.512111:0:17876:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127061.512154:0:17876:0:(import.c:65:import_set_state_nolock()) ffff9941030cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127061.512205:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876035276823296:12345-0@lo:38:llog_process_th.0 Request processed in 160us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.512213:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789127061.512255:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994219ec7480 x1876035276823296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127061.512264:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127061.512272:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789127061.512278:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789127061.512282:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789127061.512285:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789127061.512291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276823296:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789127061.512316:0:19409:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789127061.512356:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.512360:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.512363:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.512366:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.512393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.512396:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.512404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.512408:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127061.512441:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276823552:0@lo:400:kworker.0 00000100:00100000:0.0:1789127061.512467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127061.512487:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127061.512492:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276823680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127061.512515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127061.512549:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823680 00000100:00100000:0.0:1789127061.512552:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823680 00000100:00100000:0.0:1789127061.512583:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127061.512591:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276823680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127061.512632:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276823680:12345-0@lo:400:kworker.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.512639:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127061.512686:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276823680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127061.512794:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276823424:0@lo:400:kworker.0 00000100:00100000:3.0:1789127061.512823:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.512850:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127061.512857:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276823808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127061.512891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.512931:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823552 00000100:00100000:3.0:1789127061.512934:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823552 00000100:00100000:3.0:1789127061.512956:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823808 00000100:00100000:3.0:1789127061.512958:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823808 00000100:00100000:3.0:1789127061.512970:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127061.512977:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276823552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127061.513014:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276823552:12345-0@lo:400:kworker.0 Request processed in 37us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.513020:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127061.513033:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127061.513040:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276823808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127061.513070:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276823808:12345-0@lo:400:kworker.0 Request processed in 30us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.513077:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789127061.513179:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994219ec5e00 x1876035276823552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127061.513190:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276823552:0@lo:400:kworker.0 00010000:00080000:3.0:1789127061.513211:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994219ec6d00 x1876035276823808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127061.513219:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276823808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127061.513389:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823424 00000100:00100000:0.0:1789127061.513393:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823424 00000100:00100000:0.0:1789127061.513417:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127061.513424:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276823424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127061.513470:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276823424:12345-0@lo:400:kworker.0 Request processed in 47us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.513476:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127061.513543:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276823424:0@lo:400:kworker.0 00000020:01000004:0.0:1789127061.513573:0:19409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127061.513595:0:19409:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9941032d9a48) 00000020:00000080:0.0:1789127061.513615:0:19409:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789127061.513731:0:19409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942064a1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127061.513742:0:19409:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9942064a1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127061.513746:0:19409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942064a1800 3 00010000:00080000:0.0:1789127061.513799:0:19409:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102f33000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789127061.516133:0:19409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789127061.516495:0:19409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789127061.516561:0:19409:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789127061.516586:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa840b4da666ebdaa 00000100:00080000:1.0:1789127061.516599:0:19409:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127061.516607:0:19409:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff994102f33000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127061.516705:0:19409:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941043e4780 x1876035276823936/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127061.516733:0:19409:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789127061.516952:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276823936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127061.517040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127061.517104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.517109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.517122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.517125:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.517128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.517131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127061.517134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127061.517137:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127061.517284:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276823936 00000100:00100000:2.0:1789127061.517299:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276823936 00000100:00100000:2.0:1789127061.517353:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127061.517364:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276823936:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127061.517394:0:17877:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:2.0:1789127061.517435:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa840b4da666ebdb1 00000004:00100000:2.0:1789127061.517451:0:17877:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127061.517485:0:17877:0:(import.c:65:import_set_state_nolock()) ffff994207563800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127061.517543:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876035276823936:12345-0@lo:38:llog_process_th.0 Request processed in 180us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127061.517552:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789127061.517742:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9941043e4780 x1876035276823936/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127061.517754:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127061.517762:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789127061.517775:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789127061.517780:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789127061.517783:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102f33000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127061.517791:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276823936:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789127061.517843:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789127061.518021:0:19381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789127061.518057:0:19381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127061.518086:0:19381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127061.518098:0:19381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127061.518162:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127061.518165:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127061.518166:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127061.518168:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127061.518169:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127061.518171:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127061.518172:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127061.518175:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127061.518176:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127061.518180:0:19381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789127061.518183:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127061.518184:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127061.518185:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127061.518187:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127061.518188:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127061.518189:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127061.518199:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127061.518201:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127061.518202:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127061.518217:0:19381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789127061.518232:0:19381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276824064:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127061.518277:0:19381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127061.518315:0:19381:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.518399:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824064 00000100:00100000:3.0:1789127061.518405:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824064 00000100:00100000:3.0:1789127061.518439:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127061.518447:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276824064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127061.518468:0:17872:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789127061.518482:0:17872:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789127061.526003:0:17872:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789127061.526023:0:17872:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789127061.526101:0:17892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127061.526106:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127061.526142:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526163:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 21 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526171:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 21 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526179:0:17892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526220:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 21 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526241:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 21 pid: 17870 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127061.526270:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276824192:0@lo:104: 00000100:00100000:0.0:1789127061.526626:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:19381:x1876035276824064:12345-0@lo:253:mount.lustre.0 Request processed in 8177us (8346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127061.526637:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789127061.526729:0:19381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:19381:1876035276824064:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127061.526744:0:19381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789127061.526747:0:19381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127061.526748:0:19381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127061.526750:0:19381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127061.526751:0:19381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127061.526753:0:19381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127061.526754:0:19381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127061.526762:0:19381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127061.526764:0:19381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127061.526765:0:19381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127061.526779:0:19381:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789127061.526937:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127061.526982:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 20 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127061.526991:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 20 pid: 17872 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127061.527000:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276824320:0@lo:104: 00000100:00100000:2.0:1789127061.527451:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127061.527475:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127061.528733:0:17861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789127061.528757:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824192 00000100:00100000:3.0:1789127061.528764:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824192 00000100:00100000:3.0:1789127061.528801:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824320 00000100:00100000:3.0:1789127061.528804:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824320 00000100:00100000:3.0:1789127061.528823:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127061.528832:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276824192:12345-0@lo:104: 00010000:00010000:3.0:1789127061.528849:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.528928:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127061.528935:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276824192:12345-0@lo:104: Request processed in 104us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.528943:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127061.528965:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127061.528973:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276824320:12345-0@lo:104: 00010000:00010000:3.0:1789127061.528982:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529030:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127061.529035:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276824320:12345-0@lo:104: Request processed in 64us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.529042:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789127061.529081:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127061.529088:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529096:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127061.529101:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529110:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127061.529132:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127061.529139:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127061.529175:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529183:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127061.529205:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529213:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104396400/0xa840b4da666ebd09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd10 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529231:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127061.529233:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529237:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127061.529239:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529243:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127061.529247:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127061.529261:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127061.529274:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529278:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127061.529291:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529298:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212167c00/0xa840b4da666ebcfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd02 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529315:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127061.529318:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127061.529321:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127061.529329:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127061.529348:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276824448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127061.529383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.529555:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276824576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127061.529584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127061.529624:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824448 00000100:00100000:3.0:1789127061.529629:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824448 00010000:00010000:3.0:1789127061.529667:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 21 pid: 17870 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127061.529686:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824576 00000100:00100000:3.0:1789127061.529689:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824576 00010000:00010000:3.0:1789127061.529699:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 22 pid: 17872 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127061.529710:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127061.529715:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3642:x1876035276824448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127061.529725:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127061.529731:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 22 pid: 17870 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529741:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 22 pid: 17870 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529758:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127061.529787:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3642:x1876035276824448:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.529794:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127061.529807:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127061.529813:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3639:x1876035276824576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127061.529827:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127061.529831:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 21 pid: 17872 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529840:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 21 pid: 17872 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529851:0:17863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529860:0:17863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127061.529872:0:17863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013064608s 00010000:00010000:3.0:1789127061.529877:0:17863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529883:0:17863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529890:0:17863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529897:0:17863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529902:0:17863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127061.529906:0:17863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529913:0:17863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529927:0:17863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.529937:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127061.529967:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3639:x1876035276824576:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127061.529973:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127061.530054:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276824448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127061.530078:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276824576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127061.530101:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166e00/0xa840b4da666ebd10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebd09 expref: 20 pid: 17870 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127061.530120:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276824192:0@lo:104: 00010000:00010000:3.0:1789127061.530133:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67600/0xa840b4da666ebd02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebcfb expref: 19 pid: 17872 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127061.530140:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276824320:0@lo:104: 00010000:00010000:3.0:1789127061.530154:0:17892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.530162:0:17892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.530168:0:17892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127061.530174:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2400/0xa840b4da666ebdb8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789127061.536556:0:19381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1789127061.546832:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789127061.548506:0:19381:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789127061.548513:0:19381:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789127061.548548:0:19381:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789127061.548589:0:19381:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789127061.548610:0:19381:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789127061.548636:0:19381:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789127061.550816:0:19381:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127061.551155:0:19381:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789127062.340549:0:19463:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127062.340937:0:19463:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127062.575178:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127062.956424:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789127063.083284:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127063.083295:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422035d800 from 9 10000000:01000000:3.0:1789127063.083302:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127063.083359:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127063.083373:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127063.083385:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127063.083415:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127063.083500:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127063.083562:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994207e1dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127063.083698:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824704 00000100:00100000:1.0:1789127063.083715:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824704 00000100:00100000:1.0:1789127063.083780:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127063.083804:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:17874:x1876035276824704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127063.083822:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127063.083844:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebdbf expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.083876:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 20 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.083888:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 20 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.083898:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396800, rc 0) 00000100:00100000:1.0:1789127063.083986:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:17874:x1876035276824704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127063.083995:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789127063.084242:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127063.084261:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127063.084271:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127063.084409:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127063.084478:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127063.084576:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127063.085148:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824832 00000100:00100000:1.0:1789127063.085158:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824832 00000100:00100000:1.0:1789127063.085230:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789127063.085239:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:17874:x1876035276824832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789127063.085256:0:17872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789127063.085273:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789127063.085343:0:17872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789127063.085497:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:17874:x1876035276824832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 256us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127063.085514:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789127063.085604:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127063.086365:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127063.086376:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.086394:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127063.086403:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127063.086406:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9941050e6800 from 9 10000000:01000000:1.0:1789127063.086408:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127063.086439:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.086446:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.086456:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127063.086473:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127063.086510:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127063.087869:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127063.088389:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276824960 00000100:00100000:2.0:1789127063.088398:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276824960 00000100:00100000:2.0:1789127063.088503:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789127063.088515:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:17874:x1876035276824960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127063.088531:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127063.088548:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebdcd expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127063.088578:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 21 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127063.088592:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 21 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127063.088604:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:2.0:1789127063.088698:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276824960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127063.088713:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789127063.088962:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276824960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127063.088977:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.088987:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127063.089056:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276825088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789127063.089164:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127063.089195:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127063.089230:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825088 00000100:00100000:2.0:1789127063.089235:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825088 00000100:00100000:2.0:1789127063.089356:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127063.089365:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276825088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127063.089382:0:17870:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127063.089399:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127063.089402:0:17870:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789127063.089485:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276825088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127063.089498:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127063.089570:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276825088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127063.089640:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127063.089683:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127063.089693:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127063.595796:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127064.620682:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127064.748838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127064.748862:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276825216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127064.748945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127064.748991:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825216 00000100:00100000:1.0:1789127064.749000:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825216 00000100:00100000:1.0:1789127064.749046:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127064.749056:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276825216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127064.749100:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127064.749155:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276825216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127064.749163:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127064.749218:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276825216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127065.258890:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276825344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127065.258964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127065.259060:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825344 00000100:00100000:3.0:1789127065.259070:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825344 00000100:00100000:3.0:1789127065.259144:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127065.259155:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276825344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127065.259191:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127065.259258:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276825344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127065.259266:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127065.259314:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276825344:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127065.647456:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127066.666844:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127066.795050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127066.795060:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127066.795063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127066.795068:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127066.795105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127066.795129:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127066.795132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127066.795136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127066.795188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276825856:0@lo:400:kworker.0 00000100:00100000:1.0:1789127066.795281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.795475:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276825472:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.795533:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.795577:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276825984:0@lo:400:kworker.0 00000100:00100000:3.0:1789127066.795591:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825472 00000100:00100000:3.0:1789127066.795600:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825472 00000100:00100000:0.0:1789127066.795607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127066.795690:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789127066.795700:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3642:x1876035276825472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127066.795759:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3642:x1876035276825472:12345-0@lo:400:kworker.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127066.795778:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789127066.795853:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825984 00000100:00100000:0.0:1789127066.795857:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825984 00000100:00100000:0.0:1789127066.795890:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127066.795897:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276825984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.795933:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276825984:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.795939:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127066.795975:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276825472:0@lo:400:kworker.0 00010000:00080000:0.0:1789127066.795989:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043e61c0 x1876035276825984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127066.796001:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276825984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796048:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825856 00000100:00100000:0.0:1789127066.796052:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825856 00000100:00100000:0.0:1789127066.796107:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127066.796114:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276825856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796150:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276825856:12345-0@lo:400:kworker.0 Request processed in 37us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.796157:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127066.796177:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276825728:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.796224:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276826240:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.796263:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789127066.796269:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276825600:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.796304:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276826112:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127066.796365:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825600 00000100:00100000:0.0:1789127066.796369:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825600 00000100:00100000:0.0:1789127066.796385:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127066.796403:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276825600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796439:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276825600:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.796444:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127066.796460:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276825728 00000100:00100000:0.0:1789127066.796464:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276825728 00000100:00100000:0.0:1789127066.796479:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826240 00000100:00100000:0.0:1789127066.796481:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826240 00000100:00100000:0.0:1789127066.796512:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826112 00000100:00100000:0.0:1789127066.796524:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826112 00000100:00080000:2.0:1789127066.796538:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127066.796544:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127066.796556:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127066.796563:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276825728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796598:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276825728:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.796605:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127066.796617:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127066.796624:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276826240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127066.796671:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276825856:0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796681:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276826240:12345-0@lo:400:kworker.0 Request processed in 57us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.796688:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127066.796701:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127066.796706:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276826112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127066.796729:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276826112:12345-0@lo:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127066.796734:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127066.796767:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276825600:0@lo:400:kworker.0 00010000:00080000:0.0:1789127066.796778:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043e4f00 x1876035276826112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127066.796787:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276826112:0@lo:400:kworker.0 00010000:00080000:0.0:1789127066.796796:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043e7480 x1876035276825728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127066.796804:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276825728:0@lo:400:kworker.0 00010000:00080000:0.0:1789127066.796815:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043e5a40 x1876035276826240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127066.796834:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276826240:0@lo:400:kworker.0 00000040:00080000:0.0:1789127066.924592:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789127067.201859:0:19753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127067.695125:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127067.944635:0:19805:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127067.944929:0:19805:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127068.726600:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127068.756544:0:19855:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127068.756876:0:19855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127069.744941:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127069.867391:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276826368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127069.867487:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127069.867566:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826368 00000100:00100000:0.0:1789127069.867574:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826368 00000100:00100000:0.0:1789127069.867627:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127069.867636:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276826368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127069.867696:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789127069.867751:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276826368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127069.867759:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127069.867811:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276826368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127070.379094:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127070.379170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127070.379383:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826496 00000100:00100000:1.0:1789127070.379393:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826496 00000100:00100000:1.0:1789127070.379463:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127070.379474:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276826496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127070.379511:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127070.386536:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276826496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7053us (7355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127070.386552:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127070.388726:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127070.762890:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127055/real 1789127055] req@ffff99410488e580 x1876035276819072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127070.762921:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410488e580 x1876035276819072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127070.762945:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127055/real 1789127055] req@ffff99410488c3c0 x1876035276819200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127070.762958:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410488c3c0 x1876035276819200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127070.762977:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127070.767938:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789127070.767951:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276819072:0@lo:8:kworker.0 00000100:00080000:0.0:1789127070.767965:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127070.767974:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789127070.767978:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276819200:0@lo:8:kworker.0 00010000:00010000:3.0:1789127070.768160:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127070.768315:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1789127070.768426:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127070.768432:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127070.768434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127070.768438:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127070.771413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276826752:0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.771505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127070.771546:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276826624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.771585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127070.771645:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826752 00000100:00100000:3.0:1789127070.771668:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826752 00000100:00100000:3.0:1789127070.771717:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127070.771728:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.771787:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276826752:12345-0@lo:400:kworker.0 Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.771795:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789127070.771838:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501b480 x1876035276826752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127070.771853:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276826752:0@lo:400:kworker.0 00000100:00080000:2.0:1789127070.772844:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127070.772850:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127070.772854:0:8:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127070.772861:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1789127070.772866:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127070.772872:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99423d063800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127070.772887:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826624 00000100:00100000:2.0:1789127070.772892:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826624 00000100:00100000:2.0:1789127070.772965:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127070.772974:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3640:x1876035276826624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127070.773039:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3640:x1876035276826624:12345-0@lo:400:kworker.0 Request processed in 67us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127070.773046:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127070.783506:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276826624:0@lo:400:kworker.0 00000100:00100000:2.0:1789127070.783587:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994105018b40 x1876035276826880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127070.783621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127070.783625:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127070.783629:0:8:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127070.783633:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1789127070.783637:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127070.783643:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99423d039000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127070.783673:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276826880:0@lo:8:kworker.0 00000100:00100000:2.0:1789127070.783740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127070.783794:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b480 x1876035276827008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127070.783813:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276827008:0@lo:8:kworker.0 00000100:00100000:2.0:1789127070.783834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127070.783862:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276826880 00000100:00100000:2.0:1789127070.783868:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276826880 00000100:00100000:2.0:1789127070.783889:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827008 00000100:00100000:2.0:1789127070.783891:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827008 00000100:00100000:2.0:1789127070.783903:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127070.783910:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276826880:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789127070.783938:0:19387:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1789127070.783968:0:19387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebddb 00002000:00100000:2.0:1789127070.783980:0:19387:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff994207567800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789127070.783984:0:19387:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789127070.783987:0:19387:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789127070.785147:0:19387:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789127070.785356:0:19387:0:(import.c:65:import_set_state_nolock()) ffff994207562800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127070.785436:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276826880:12345-0@lo:8:kworker.0 Request processed in 1523us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127070.785446:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127070.785475:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127070.785480:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276827008:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789127070.785497:0:19387:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789127070.812788:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127070.812810:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276827136:0@lo:400:kworker.0 00000100:00100000:0.0:1789127070.812877:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127070.812924:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827136 00000100:00100000:0.0:1789127070.812932:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827136 00000100:00100000:0.0:1789127070.812982:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127070.813303:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276827136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127070.813357:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276827136:12345-0@lo:400:kworker.0 Request processed in 367us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127070.813365:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789127070.813401:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043d8b40 x1876035276827136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127070.813414:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276827136:0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.813493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127070.822269:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276827264:0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.823638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127070.823713:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276827392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.823755:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827264 00000100:00100000:3.0:1789127070.823765:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827264 00000100:00100000:0.0:1789127070.823766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127070.823830:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827392 00000100:00100000:3.0:1789127070.823834:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827392 00000100:00100000:0.0:1789127070.823846:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127070.823864:0:17876:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127070.823873:0:17876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789127070.823889:0:17877:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127070.823898:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127070.823906:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276827392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127070.824110:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276827392:12345-0@lo:400:kworker.0 Request processed in 204us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.824118:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789127070.824166:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043da1c0 x1876035276827392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127070.824180:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276827392:0@lo:400:kworker.0 00000100:00100000:0.0:1789127070.825356:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276827264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127070.825434:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276827264:12345-0@lo:400:kworker.0 Request processed in 1579us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127070.825443:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789127070.826387:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994105018b40 x1876035276826880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.826400:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127070.826411:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789127070.826420:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789127070.826425:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789127070.826429:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789127070.826449:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789127070.826466:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276826880:0@lo:8:kworker.0 00000100:00080000:2.0:1789127070.826491:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127070.826496:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127070.826538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941043d8b40 x1876035276827264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.826548:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276827264:0@lo:400:kworker.0 00000004:00080000:3.0:1789127070.826618:0:18622:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789127070.826638:0:18622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827648:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789127070.826704:0:18622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127070.826728:0:18622:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127070.826744:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127070.826754:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127070.826784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127070.826813:0:19386:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127070.826820:0:19386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789127070.826840:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827520 00000100:00100000:3.0:1789127070.826846:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827520 00000004:00080000:0.0:1789127070.826892:0:18621:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789127070.826904:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127070.826914:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276827520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127070.826939:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000004:00080000:0.0:1789127070.826980:0:18621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 496031330520ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789127070.826987:0:18621:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1789127070.827414:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127070.829517:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276827520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2596us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.829531:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127070.829721:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410480a1c0 x1876035276827520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127070.829746:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127070.831805:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827648 00000100:00100000:3.0:1789127070.831816:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827648 00000100:00100000:1.0:1789127070.832142:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127070.832710:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18622:x1876035276827648:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789127070.835088:0:18613:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789127070.838854:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276827008:12345-0@lo:8:kworker.0 Request processed in 53365us (55011us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127070.838868:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789127070.843190:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127070.843203:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127070.843208:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276827008:0@lo:8:kworker.0 00002000:00080000:3.0:1789127070.853607:0:19941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789127070.853617:0:19941:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789127070.853895:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18622:x1876035276827648:12345-0@lo:7:osp-pre-0-1.0 Request processed in 21188us (27186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.853907:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127070.856681:0:18622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994104809a40 x1876035276827648/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127086 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.856708:0:18622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827648:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789127070.856722:0:18622:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789127070.856776:0:18622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827776:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789127070.856834:0:18622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127070.856863:0:18622:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127070.856938:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827776 00000100:00100000:3.0:1789127070.856945:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827776 00000100:00100000:3.0:1789127070.857009:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127070.857020:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18622:x1876035276827776:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789127070.857046:0:19386:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789127070.857096:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18622:x1876035276827776:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.857104:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127070.857492:0:18622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994105018b40 x1876035276827776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127086 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.857503:0:18622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827776:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789127070.857512:0:18622:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789127070.857534:0:18622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827904:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789127070.857558:0:18622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127070.857588:0:18622:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127070.857681:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276827904 00000100:00100000:3.0:1789127070.857686:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276827904 00000100:00100000:3.0:1789127070.857712:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127070.857718:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18622:x1876035276827904:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789127070.857747:0:19387:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1789127070.892815:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789127070.892831:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789127070.893030:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:18622:x1876035276827904:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35307us (35465us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127070.893041:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789127070.893212:0:18622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994105018b40 x1876035276827904/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127086 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.893224:0:18622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789127070.893230:0:18622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18622:1876035276827904:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789127070.893247:0:18622:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789127070.893302:0:18622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18622:1876035276828032:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789127070.893342:0:18622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127070.893372:0:18622:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127070.893593:0:17888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828032 00000100:00100000:3.0:1789127070.893599:0:17888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828032 00000100:00100000:3.0:1789127070.893639:0:17888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127070.893668:0:17888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18622:x1876035276828032:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789127070.893720:0:17888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18622:x1876035276828032:12345-0@lo:900:osp-pre-0-1.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127070.893727:0:17888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127070.893874:0:18622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994105018b40 x1876035276828032/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127086 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127070.893884:0:18622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18622:1876035276828032:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789127071.786911:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127072.172025:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127072.811300:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127073.836340:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127074.858891:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127074.987120:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127074.987143:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276828160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127074.987213:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127074.989062:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828160 00000100:00100000:2.0:1789127074.989076:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828160 00000100:00100000:2.0:1789127074.989134:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127074.989144:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276828160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127074.989180:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127074.989263:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276828160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127074.989270:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127074.989324:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276828160:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1789127075.435930:0:20202:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127075.435935:0:20202:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789127075.435936:0:20202:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789127075.436056:0:20202:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994207565800 00000020:01000004:2.0:1789127075.436071:0:20202:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789127075.436087:0:20202:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789127075.436100:0:20202:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9942366b9a48) 00000020:00000080:2.0:1789127075.436117:0:20202:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1789127075.504156:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276828288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127075.504230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.504862:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828288 00000100:00100000:3.0:1789127075.504872:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828288 00000100:00100000:3.0:1789127075.504936:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127075.504947:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276828288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127075.504985:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127075.505056:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276828288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.505063:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127075.505111:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276828288:0@lo:41:osp-pre-1-0.0 00100000:10000000:1.0:1789127075.562907:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789127075.566333:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789127075.566732:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789127075.567041:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789127075.567308:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789127075.567502:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789127075.567857:0:20202:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789127075.573312:0:20202:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789127075.573934:0:20202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789127075.573949:0:20202:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789127075.574140:0:20202:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ebde9 00000020:01000004:1.0:1789127075.574149:0:20202:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789127075.574173:0:20202:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789127075.574176:0:20202:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789127075.574182:0:20202:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789127075.574262:0:20202:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789127075.574267:0:20202:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789127075.613391:0:20202:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127075.613430:0:20202:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789127075.613435:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127075.613437:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127075.613438:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127075.613440:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127075.613441:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127075.613443:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127075.613444:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127075.613446:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127075.613447:0:20202:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127075.613450:0:20202:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789127075.613452:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127075.613454:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127075.613455:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127075.613456:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127075.613457:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127075.613458:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127075.613459:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127075.613461:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127075.613462:0:20202:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127075.613494:0:20202:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789127075.613522:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127075.613602:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.613757:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.615478:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828416 00000100:00100000:3.0:1789127075.615492:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828416 00000100:00100000:3.0:1789127075.615596:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789127075.615620:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:20202:x1876035276828416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789127075.615681:0:17871:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789127075.615685:0:17871:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789127075.615689:0:17871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789127075.616196:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:20202:x1876035276828416:12345-0@lo:253:mount.lustre.0 Request processed in 577us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.616214:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789127075.616298:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127075.616311:0:20202:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789127075.616314:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127075.616316:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789127075.616318:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127075.616319:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127075.616321:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127075.616322:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127075.616324:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127075.616325:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127075.616327:0:20202:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127075.616348:0:20202:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994207565800 from lustre-OST0001 10000000:01000000:0.0:1789127075.616375:0:20202:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789127075.616378:0:20202:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789127075.616386:0:20202:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994103ec8000 local copy 00010000:00010000:0.0:1789127075.616397:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127075.616489:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127075.616526:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.617042:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127075.617322:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828544 00000100:00100000:1.0:1789127075.617329:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828544 00000100:00100000:0.0:1789127075.617420:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127075.617429:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:20202:x1876035276828544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127075.617528:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:20202:x1876035276828544:12345-0@lo:501:mount.lustre.0 Request processed in 99us (1000us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127075.617536:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789127075.617609:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127075.617630:0:20202:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789127075.617680:0:20202:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789127075.617690:0:20202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.617702:0:20202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127075.617741:0:20202:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994207565800 10000000:01000000:1.0:1789127075.617745:0:20202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127075.617761:0:20202:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127075.617765:0:20202:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127075.617769:0:20202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789127075.617772:0:20202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789127075.617803:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.617812:0:20202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.617824:0:20202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127075.617840:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127075.617874:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.617893:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.618027:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828672 00000100:00100000:0.0:1789127075.618038:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828672 00000100:00100000:0.0:1789127075.618072:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789127075.618078:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:20202:x1876035276828672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127075.618087:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127075.618100:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166400/0xa840b4da666ebdf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebdf0 expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.618122:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166400/0xa840b4da666ebdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebdf0 expref: 22 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.618134:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166400/0xa840b4da666ebdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebdf0 expref: 22 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.618155:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166400, rc 0) 00000100:00100000:0.0:1789127075.618190:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276828672:12345-0@lo:101:mount.lustre.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.618197:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127075.620458:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127075.620497:0:20202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.620510:0:20202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127075.627435:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789127075.628454:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127075.632012:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789127075.632091:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789127075.632107:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789127075.632121:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789127075.632135:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789127075.633364:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789127075.633400:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789127075.633406:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789127075.633529:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127075.633600:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.633672:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.634116:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828800 00000100:00100000:3.0:1789127075.634124:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828800 00000100:00100000:3.0:1789127075.634189:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789127075.634201:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276828800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127075.634376:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276828800:12345-0@lo:501:mount.lustre.0 Request processed in 177us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.634385:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127075.634605:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127075.634695:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127075.634742:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.634780:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.635240:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276828928 00000100:00100000:3.0:1789127075.635246:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276828928 00000100:00100000:3.0:1789127075.635289:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789127075.635298:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276828928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127075.636190:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276828928:12345-0@lo:503:mount.lustre.0 Request processed in 889us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.636198:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789127075.640330:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276828928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127075.641573:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127075.642373:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127075.642467:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.642571:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.646873:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829056 00000100:00100000:3.0:1789127075.646888:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829056 00000100:00100000:3.0:1789127075.646996:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789127075.647008:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276829056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127075.649849:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276829056:12345-0@lo:502:mount.lustre.0 Request processed in 2835us (7374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.649880:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789127075.650009:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127075.650312:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789127075.650345:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789127075.650358:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789127075.650370:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789127075.650380:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789127075.650391:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789127075.650401:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789127075.650411:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789127075.650424:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789127075.650461:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127075.650515:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.655003:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127075.660113:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829184 00000100:00100000:2.0:1789127075.660131:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829184 00000100:00100000:2.0:1789127075.660206:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789127075.660219:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276829184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127075.660403:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276829184:12345-0@lo:502:mount.lustre.0 Request processed in 186us (9887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.660411:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789127075.660909:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127075.661005:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789127075.661028:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789127075.661916:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127075.661925:0:20206:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789127075.661931:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127075.661933:0:20206:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789127075.661939:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127075.661953:0:20206:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9941032db490) 00000020:00000080:0.0:1789127075.661978:0:20206:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789127075.661984:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127075.662077:0:20206:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994207565800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789127075.662087:0:20206:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127075.662094:0:20206:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ebe05 00010000:00010000:0.0:1789127075.670422:0:20206:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789127075.671963:0:20206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789127075.678561:0:20206:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789127075.698539:0:20206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789127075.698553:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127075.698561:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127075.698563:0:20206:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789127075.698567:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127075.698572:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127075.698573:0:20206:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127075.698576:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127075.698578:0:20206:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127075.698580:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127075.698582:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127075.698584:0:20206:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127075.698586:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127075.698589:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127075.698590:0:20206:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127075.698593:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789127075.698612:0:20206:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127075.698616:0:20206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127075.698617:0:20206:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127075.698628:0:20206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789127075.710105:0:20202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789127075.710287:0:20202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789127075.710356:0:20202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.710370:0:20202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127075.710431:0:20202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994207565800 from 1 10000000:01000000:0.0:1789127075.710435:0:20202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127075.710482:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.710490:0:20202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.710502:0:20202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127075.710528:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127075.710598:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.710643:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.711422:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829312 00000100:00100000:3.0:1789127075.711434:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829312 00000100:00100000:3.0:1789127075.711492:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789127075.711503:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:20202:x1876035276829312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127075.711519:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127075.711537:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebe0c expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.711566:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.711577:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.711587:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67600, rc 0) 00000100:00100000:3.0:1789127075.711664:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829312:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.711672:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127075.714940:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127075.717103:0:20202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.717120:0:20202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127075.723346:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789127075.723626:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127075.724111:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789127075.724138:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789127075.724170:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789127075.724183:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789127075.724394:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127075.724465:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.724512:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.726551:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829440 00000100:00100000:0.0:1789127075.726567:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829440 00000100:00100000:0.0:1789127075.726640:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127075.726670:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127075.726850:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829440:12345-0@lo:501:mount.lustre.0 Request processed in 199us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.726858:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789127075.730906:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127075.730976:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127075.731076:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.731121:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127075.731348:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829568 00000100:00100000:2.0:1789127075.731356:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829568 00000100:00100000:2.0:1789127075.731415:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789127075.731426:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127075.731915:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829568:12345-0@lo:503:mount.lustre.0 Request processed in 489us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.731932:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789127075.732183:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127075.733342:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127075.733425:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127075.733491:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.733541:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.733698:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829696 00000100:00100000:3.0:1789127075.733707:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829696 00000100:00100000:3.0:1789127075.733764:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789127075.733773:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127075.733887:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829696:12345-0@lo:502:mount.lustre.0 Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.733894:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789127075.734158:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127075.734476:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789127075.734500:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789127075.734513:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789127075.734524:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789127075.734536:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789127075.734548:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789127075.734559:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789127075.734571:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789127075.734583:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789127075.734595:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789127075.734608:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:1.0:1789127075.734620:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:1.0:1789127075.734632:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:1.0:1789127075.734892:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:1.0:1789127075.734912:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:1.0:1789127075.734928:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:1.0:1789127075.734940:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:1.0:1789127075.734972:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127075.735038:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.735070:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942365ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.735300:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829824 00000100:00100000:3.0:1789127075.735313:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829824 00000100:00100000:3.0:1789127075.735364:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789127075.735375:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127075.735483:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829824:12345-0@lo:502:mount.lustre.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.735490:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789127075.739536:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127075.739669:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:1.0:1789127075.739686:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789127075.741592:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741603:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741605:0:20210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127075.741612:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994207565800 00000020:00000080:1.0:1789127075.741615:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741622:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741624:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741626:0:20210:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127075.741628:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741630:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741631:0:20210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127075.741634:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994207565800 00000020:00000080:1.0:1789127075.741636:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741708:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741711:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741712:0:20210:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127075.741714:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741716:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741718:0:20210:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127075.741721:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994207565800 00000020:00000080:1.0:1789127075.741723:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741761:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741764:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741765:0:20210:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127075.741767:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741770:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741771:0:20210:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127075.741774:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994207565800 00000020:00000080:1.0:1789127075.741776:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741788:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741790:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741791:0:20210:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127075.741794:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741796:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741797:0:20210:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127075.741800:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994207565800 00000020:00000080:1.0:1789127075.741801:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741813:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741815:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741816:0:20210:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127075.741819:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127075.741821:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741822:0:20210:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127075.741825:0:20210:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994207565800 00000020:00000080:1.0:1789127075.741827:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127075.741846:0:20210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127075.741848:0:20210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127075.741850:0:20210:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789127075.741853:0:20210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789127075.742046:0:20202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789127075.742073:0:20202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127075.742096:0:20202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742108:0:20202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127075.742159:0:20202:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127075.742162:0:20202:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994207565800 10000000:01000000:0.0:1789127075.742165:0:20202:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994207565800 10000000:01000000:0.0:1789127075.742169:0:20202:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127075.742174:0:20202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994207565800 from 1 10000000:01000000:0.0:1789127075.742177:0:20202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127075.742276:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742287:0:20202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742300:0:20202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127075.742336:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127075.742403:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.742448:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276829952 00000100:00100000:0.0:1789127075.742779:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276829952 00000100:00100000:0.0:1789127075.742839:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127075.742849:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:20202:x1876035276829952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127075.742862:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127075.742877:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212167000/0xa840b4da666ebe21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebe1a expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742903:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212167000/0xa840b4da666ebe21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebe1a expref: 24 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742915:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212167000/0xa840b4da666ebe21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebe1a expref: 24 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.742926:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167000, rc 0) 00000100:00100000:0.0:1789127075.742964:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276829952:12345-0@lo:101:mount.lustre.0 Request processed in 117us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.742971:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127075.743024:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.743048:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276829952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127075.743063:0:20202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.743072:0:20202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127075.756540:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789127075.756844:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127075.757074:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789127075.757101:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789127075.757115:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789127075.757127:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789127075.757139:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789127075.757164:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789127075.757177:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789127075.757190:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789127075.757398:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789127075.757423:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789127075.757445:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789127075.757467:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789127075.757489:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789127075.757507:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789127075.757521:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789127075.757535:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789127075.757550:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789127075.757567:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789127075.757586:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789127075.757618:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789127075.757636:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789127075.757675:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789127075.757694:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789127075.757722:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789127075.757737:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789127075.757749:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789127075.757761:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789127075.757773:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789127075.757784:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789127075.757797:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789127075.757808:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789127075.757820:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789127075.757832:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789127075.757843:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789127075.757855:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789127075.757878:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789127075.757891:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789127075.757903:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789127075.757915:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789127075.757929:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789127075.757942:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789127075.757954:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789127075.757979:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789127075.757995:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789127075.758009:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789127075.758032:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789127075.758054:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789127075.758059:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789127075.758153:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127075.758530:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.758587:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.759264:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830080 00000100:00100000:0.0:1789127075.759273:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830080 00000100:00100000:0.0:1789127075.759329:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789127075.759339:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127075.760298:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830080:12345-0@lo:501:mount.lustre.0 Request processed in 955us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.760309:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127075.760409:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127075.760459:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127075.760509:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.760545:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.760718:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830208 00000100:00100000:0.0:1789127075.760723:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830208 00000100:00100000:0.0:1789127075.761276:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127075.761287:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127075.761399:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830208:12345-0@lo:503:mount.lustre.0 Request processed in 114us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.761406:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789127075.761486:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127075.761945:0:20202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127075.762039:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127075.762088:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.766929:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127075.776606:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830336 00000100:00100000:2.0:1789127075.776623:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830336 00000100:00100000:2.0:1789127075.776706:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789127075.776717:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127075.776921:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830336:12345-0@lo:502:mount.lustre.0 Request processed in 206us (14832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.776929:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789127075.776945:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127075.780860:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789127075.780914:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789127075.780929:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789127075.780940:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789127075.780953:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789127075.781492:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789127075.781515:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789127075.781530:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789127075.781544:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789127075.781557:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789127075.781571:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789127075.783633:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789127075.783681:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789127075.783704:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789127075.783718:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789127075.783731:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789127075.783755:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789127075.783770:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789127075.783781:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789127075.783794:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789127075.783807:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789127075.783819:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789127075.783846:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789127075.783867:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789127075.783882:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789127075.783894:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789127075.783907:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789127075.783932:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789127075.783948:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789127075.783960:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789127075.783990:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789127075.784023:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789127075.784047:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789127075.784067:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789127075.784084:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789127075.784102:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789127075.784124:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789127075.784145:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789127075.784165:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789127075.784183:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789127075.784220:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789127075.784237:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789127075.784251:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789127075.784264:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789127075.784279:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789127075.784292:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789127075.784311:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789127075.784335:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789127075.784406:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127075.784498:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127075.784541:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942401f6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127075.784679:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830464 00000100:00100000:0.0:1789127075.784688:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830464 00000100:00100000:0.0:1789127075.784753:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789127075.784765:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127075.784909:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830464:12345-0@lo:502:mount.lustre.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.784916:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789127075.785344:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127075.785553:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789127075.785579:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789127075.785606:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127075.785676:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.785706:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127075.785749:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830592 00000100:00100000:1.0:1789127075.785756:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830592 00000100:00100000:1.0:1789127075.785796:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127075.785804:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127075.785903:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276830592:12345-0@lo:502:mount.lustre.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127075.785911:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127075.790849:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276830592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127075.790947:0:20202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789127075.790960:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789127075.795262:0:20216:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789127075.795281:0:20216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9942290f1a48) 00000020:00000080:3.0:1789127075.795311:0:20216:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789127075.795414:0:20216:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994207565800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789127075.795419:0:20216:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994207565800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789127075.795422:0:20216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994207565800 3 00010000:00080000:3.0:1789127075.795463:0:20216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102c7e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127075.798591:0:20216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789127075.801521:0:20216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789127075.801570:0:20216:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789127075.801583:0:20216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa840b4da666ebe2f 00000100:00080000:3.0:1789127075.801596:0:20216:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127075.801603:0:20216:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102c7e800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127075.801662:0:20216:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410480a1c0 x1876035276830720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127075.801693:0:20216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127075.801743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127075.801747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127075.801749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127075.801752:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127075.801775:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127075.801778:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127075.801780:0:8:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127075.801783:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1789127075.801788:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789127075.801798:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99423d039000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127075.801810:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488c000 x1876035276831488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127075.803079:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276830720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127075.803175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.803237:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276831488:0@lo:8:kworker.0 00000100:00100000:3.0:1789127075.803249:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276830848:0@lo:400:kworker.0 00000100:00100000:0.0:1789127075.803276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.803302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.803325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276831104:0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.803334:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276831360:0@lo:400:kworker.0 00000100:00100000:0.0:1789127075.803363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.803378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127075.803387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276831744:0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.803408:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127075.803417:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276830976:0@lo:400:kworker.0 00000100:00100000:0.0:1789127075.803428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.803743:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831488 00000100:00100000:2.0:1789127075.803811:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831488 00000100:00100000:2.0:1789127075.803846:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831360 00000100:00100000:2.0:1789127075.803850:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831360 00000100:00100000:2.0:1789127075.803893:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127075.803980:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276831360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127075.804051:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789127075.804057:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276831360:12345-0@lo:400:kworker.0 Request processed in 154us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.804062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276831232:0@lo:400:kworker.0 00000100:00100000:2.0:1789127075.804077:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127075.804102:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127075.804104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.804111:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1876035276831488:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789127075.804129:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276831872:0@lo:400:kworker.0 00000100:00100000:2.0:1789127075.804173:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1876035276831488:12345-0@lo:8:kworker.0 Request processed in 62us (897us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127075.804179:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127075.804197:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830720 00000100:00100000:2.0:1789127075.804267:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830720 00000100:00100000:2.0:1789127075.804289:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831104 00000100:00100000:2.0:1789127075.804292:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831104 00000100:00100000:2.0:1789127075.804313:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831744 00000100:00100000:0.0:1789127075.804313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.804318:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831744 00000100:00100000:2.0:1789127075.804338:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831872 00000100:00100000:2.0:1789127075.804341:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831872 00000100:00100000:0.0:1789127075.804351:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127075.804363:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276831104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127075.804367:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127075.804379:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127075.804423:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276831104:12345-0@lo:400:kworker.0 Request processed in 63us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.804431:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276831744:12345-0@lo:400:kworker.0 Request processed in 53us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.804432:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127075.804448:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127075.804454:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127075.804463:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276831872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127075.804468:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127075.804474:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276830720:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127075.804493:0:17876:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000100:00100000:0.0:1789127075.804500:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276831872:12345-0@lo:400:kworker.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.804508:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:00000080:2.0:1789127075.804524:0:17876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa840b4da666ebe36 00000100:00100000:0.0:1789127075.804538:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831232 00000004:00100000:2.0:1789127075.804540:0:17876:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789127075.804544:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831232 00000100:00080000:2.0:1789127075.804577:0:17876:0:(import.c:65:import_set_state_nolock()) ffff9941049bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127075.804582:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127075.804621:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876035276830720:12345-0@lo:38:llog_process_th.0 Request processed in 145us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.804637:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127075.804678:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276831232:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789127075.804691:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127075.804697:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127075.804700:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127075.804732:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276831232:12345-0@lo:400:kworker.0 Request processed in 141us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127075.804741:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789127075.804743:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410480a1c0 x1876035276830720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127075.804780:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276831232:0@lo:400:kworker.0 00010000:00080000:0.0:1789127075.804794:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410488e940 x1876035276831872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127075.804803:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276831872:0@lo:400:kworker.0 00010000:00080000:0.0:1789127075.804812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410488e580 x1876035276831104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127075.804827:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127075.804837:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:0.0:1789127075.804838:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276831104:0@lo:400:kworker.0 00000100:00080000:2.0:1789127075.804849:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127075.804855:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127075.804858:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:0.0:1789127075.804860:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410488cf00 x1876035276831744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127075.804867:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276830720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127075.804872:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276831744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127075.804887:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127075.804893:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127075.804897:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789127075.804964:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276831488:0@lo:8:kworker.0 00000100:00100000:3.0:1789127075.806174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.806219:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276831616:0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789127075.806305:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410488ed00 x1876035276831360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127075.806317:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276831360:0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806351:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830848 00000100:00100000:3.0:1789127075.806357:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830848 00000100:00100000:3.0:1789127075.806399:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789127075.806408:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276830848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806461:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276830848:12345-0@lo:400:kworker.0 Request processed in 54us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.806469:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789127075.806504:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276830976 00000100:00100000:3.0:1789127075.806508:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276830976 00000100:00100000:3.0:1789127075.806541:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127075.806555:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276830976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806593:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276830976:12345-0@lo:400:kworker.0 Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.806599:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127075.806618:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276831616 00000100:00100000:3.0:1789127075.806621:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276831616 00000100:00100000:3.0:1789127075.806666:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127075.806675:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276831616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806709:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276831616:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.806717:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127075.806756:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276830976:0@lo:400:kworker.0 00010000:00080000:3.0:1789127075.806766:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410488da40 x1876035276831616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127075.806774:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276831616:0@lo:400:kworker.0 00000100:00100000:3.0:1789127075.806783:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276830848:0@lo:400:kworker.0 00000020:01000004:2.0:1789127075.809454:0:20216:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789127075.809480:0:20216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff994105088000) 00000020:00000080:2.0:1789127075.809506:0:20216:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789127075.809603:0:20216:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994207565800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127075.809607:0:20216:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994207565800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127075.809610:0:20216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994207565800 3 00010000:00080000:2.0:1789127075.809641:0:20216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941049bf800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127075.811886:0:20216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789127075.812146:0:20216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127075.812193:0:20216:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127075.812211:0:20216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa840b4da666ebe44 00000100:00080000:2.0:1789127075.812224:0:20216:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127075.812231:0:20216:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9941049bf800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127075.812275:0:20216:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99420aa80f00 x1876035276832000/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127075.812318:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276832000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127075.812390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.812463:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832000 00000100:00100000:2.0:1789127075.812471:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832000 00000100:00100000:2.0:1789127075.812526:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127075.812535:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276832000:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127075.812564:0:17876:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1789127075.812593:0:17876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa840b4da666ebe4b 00000004:00100000:2.0:1789127075.812606:0:17876:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127075.812638:0:17876:0:(import.c:65:import_set_state_nolock()) ffff9941049be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127075.812727:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876035276832000:12345-0@lo:38:llog_process_th.0 Request processed in 191us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.813817:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789127075.813874:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99420aa80f00 x1876035276832000/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127075.813886:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127075.813895:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789127075.813966:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127075.813972:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789127075.813975:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941049bf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127075.813984:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276832000:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789127075.814099:0:20216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789127075.814323:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127075.814330:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127075.814333:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127075.814336:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789127075.815706:0:20216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789127075.816722:0:20202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789127075.816768:0:20202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127075.816787:0:20202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127075.816802:0:20202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789127075.816857:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789127075.816860:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127075.816861:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127075.816862:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127075.816863:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127075.816865:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127075.816866:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127075.816868:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127075.816869:0:20202:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127075.816873:0:20202:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789127075.816875:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127075.816877:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127075.816878:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127075.816879:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127075.816880:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127075.816881:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127075.816882:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127075.816883:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127075.816884:0:20202:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127075.816927:0:20202:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789127075.816949:0:20202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276832128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127075.817040:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.817078:0:20202:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422902b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127075.817101:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832128 00000100:00100000:2.0:1789127075.817113:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832128 00000100:00100000:2.0:1789127075.817169:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789127075.817178:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276832128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127075.817207:0:17871:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127075.817221:0:17871:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789127075.822173:0:17871:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127075.822191:0:17871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789127075.822274:0:17892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789127075.822279:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789127075.822302:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822335:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822342:0:17892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822351:0:17892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822393:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822409:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 24 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127075.822424:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276832256:0@lo:104: 00000100:00100000:3.0:1789127075.822492:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127075.822548:0:17892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822556:0:17892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127075.822564:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276832384:0@lo:104: 00000100:00100000:3.0:1789127075.822589:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.822609:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208fd1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127075.822629:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832256 00000100:00100000:3.0:1789127075.822636:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832256 00000100:00100000:3.0:1789127075.822697:0:17861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832384 00000100:00100000:3.0:1789127075.822706:0:17861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832384 00000100:00100000:3.0:1789127075.822724:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127075.822732:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276832256:12345-0@lo:104: 00010000:00010000:3.0:1789127075.822745:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822800:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127075.822806:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:17892:x1876035276832256:12345-0@lo:104: Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.822813:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127075.822831:0:17861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127075.822837:0:17861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276832384:12345-0@lo:104: 00010000:00010000:3.0:1789127075.822844:0:17861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822875:0:17861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127075.822879:0:17861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:17892:x1876035276832384:12345-0@lo:104: Request processed in 43us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.822885:0:17861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789127075.822901:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127075.822908:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822915:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127075.822918:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.822927:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127075.822945:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127075.822952:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789127075.823584:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:20202:x1876035276832128:12345-0@lo:253:mount.lustre.0 Request processed in 6404us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127075.823593:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1789127075.824105:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.824114:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789127075.824271:0:20202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:20202:1876035276832128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127075.824284:0:20202:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789127075.824287:0:20202:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127075.824289:0:20202:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127075.824291:0:20202:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127075.824292:0:20202:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127075.824293:0:20202:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127075.824294:0:20202:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127075.824296:0:20202:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127075.824298:0:20202:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127075.824299:0:20202:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789127075.824314:0:20202:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789127075.824921:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.824931:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ebdcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdd4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.824946:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127075.824950:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.824957:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127075.824961:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.825029:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127075.825036:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127075.825041:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127075.825067:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.825072:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127075.825082:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.825087:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ebdbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebdc6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.825100:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127075.825102:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127075.825103:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127075.825110:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127075.825130:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276832640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127075.825192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127075.825295:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276832512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127075.825550:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832640 00000100:00100000:1.0:1789127075.825557:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832640 00010000:00010000:1.0:1789127075.825583:0:17864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127075.825614:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127075.825629:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276832640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127075.825644:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127075.825666:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.825677:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 24 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127075.825695:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127075.825792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127075.826062:0:17862:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789127075.826070:0:17862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789127075.826082:0:17863:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789127075.826089:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832512 00000100:00100000:3.0:1789127075.826092:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832512 00010000:00010000:3.0:1789127075.826106:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 25 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127075.826120:0:17863:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789127075.826126:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127075.826132:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3639:x1876035276832512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127075.826152:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127075.826156:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 25 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826177:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 25 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826190:0:17863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826199:0:17863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127075.826224:0:17863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013064608s 00010000:00010000:3.0:1789127075.826229:0:17863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826236:0:17863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826243:0:17863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826249:0:17863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826255:0:17863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127075.826259:0:17863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826268:0:17863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826277:0:17863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127075.826293:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127075.826331:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3639:x1876035276832512:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127075.826340:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127075.827351:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276832640:12345-0@lo:103:ldlm_bl.0 Request processed in 1720us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127075.827359:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127075.827752:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276832640:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789127075.828337:0:20202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789127075.829041:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2e00/0xa840b4da666ebdd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebdcd expref: 23 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127075.829056:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276832256:0@lo:104: 00010000:00010000:0.0:1789127075.829070:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104396800/0xa840b4da666ebdc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebdbf expref: 22 pid: 17870 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127075.829078:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17892:1876035276832384:0@lo:104: 00010000:00010000:0.0:1789127075.829101:0:17892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.829112:0:17892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.829118:0:17892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127075.829123:0:17892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67200/0xa840b4da666ebe52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127075.831369:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276832512:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789127075.837856:0:20202:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789127075.837864:0:20202:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789127075.837906:0:20202:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789127075.837956:0:20202:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789127075.837973:0:20202:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789127075.837997:0:20202:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789127075.840061:0:20202:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127075.840476:0:20202:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127075.885264:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127076.017802:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127076.017837:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276832768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127076.017943:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127076.018065:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832768 00000100:00100000:1.0:1789127076.018076:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832768 00000100:00100000:1.0:1789127076.018341:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127076.018353:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276832768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127076.018385:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789127076.018447:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276832768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127076.018455:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789127076.020712:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80780 x1876035276832768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.020739:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276832768:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789127076.145718:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789127076.655628:0:20272:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127076.656086:0:20272:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789127076.844426:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127055/real 1789127055] req@ffff99410488f840 x1876035276818816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.844457:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410488f840 x1876035276818816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.844466:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127055/real 1789127055] req@ffff99410488c780 x1876035276818944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.844476:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410488c780 x1876035276818944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127076.844495:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127076.844520:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127076.844524:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276818816:0@lo:8:kworker.0 00000100:00080000:3.0:1789127076.844538:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127076.844543:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127076.844547:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276818944:0@lo:8:kworker.0 00000100:00080000:2.0:1789127076.847113:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127076.847119:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127076.847123:0:8:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127076.847132:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1789127076.847138:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789127076.847144:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9941032b3800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127076.847169:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99420aa830c0 x1876035276833152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127076.847184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127076.847188:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127076.847202:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127076.847206:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1789127076.847209:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789127076.847213:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422043b000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127076.847226:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99420aa80b40 x1876035276833280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127076.847252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127076.847254:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127076.847256:0:8:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127076.847260:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99423d039000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127076.847270:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99420aa82940 x1876035276833792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127076.847326:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276833024:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.847439:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276833920:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.847475:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276834432:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.847512:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789127076.847517:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.847553:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276834048:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.847603:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833024 00000100:00100000:2.0:1789127076.847612:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833024 00000100:00100000:2.0:1789127076.847680:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789127076.847690:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276833024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847742:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276833024:12345-0@lo:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.847749:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789127076.847769:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833920 00000100:00100000:2.0:1789127076.847772:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833920 00000100:00100000:2.0:1789127076.847788:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834432 00000100:00100000:2.0:1789127076.847790:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834432 00000100:00100000:2.0:1789127076.847807:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833408 00000100:00100000:2.0:1789127076.847809:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833408 00000100:00100000:2.0:1789127076.847817:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834048 00000100:00100000:2.0:1789127076.847819:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834048 00000100:00100000:2.0:1789127076.847829:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127076.847834:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276833920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847861:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276833920:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.847867:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127076.847876:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127076.847881:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276834432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847918:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276834432:12345-0@lo:400:kworker.0 Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.847923:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127076.847934:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127076.847940:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276833408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.847961:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276833408:12345-0@lo:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.847974:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127076.847984:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127076.847989:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276834048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.848027:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276834048:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.848032:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789127076.848078:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80780 x1876035276833408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.848091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276833408:0@lo:400:kworker.0 00010000:00080000:2.0:1789127076.848101:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104809a40 x1876035276834048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.848108:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276834048:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.848116:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276833024:0@lo:400:kworker.0 00010000:00080000:2.0:1789127076.848125:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80000 x1876035276833920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.848132:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276833920:0@lo:400:kworker.0 00010000:00080000:2.0:1789127076.848141:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fb8c3c0 x1876035276834432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.848148:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276834432:0@lo:400:kworker.0 00000100:00080000:2.0:1789127076.848178:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127076.848851:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276833536:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.848911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.848941:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276834176:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.848962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.848983:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127076.848989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276832896:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.849052:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276833664:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.849098:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276834304:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.849143:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276832896 00000100:00100000:0.0:1789127076.849149:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276832896 00000100:00100000:0.0:1789127076.849187:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127076.849196:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3641:x1876035276832896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849236:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3641:x1876035276832896:12345-0@lo:400:kworker.0 Request processed in 41us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127076.849243:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127076.849273:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833664 00000100:00100000:0.0:1789127076.849277:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833664 00000100:00100000:0.0:1789127076.849304:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127076.849309:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276833664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849351:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276833664:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127076.849356:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127076.849386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276832896:0@lo:400:kworker.0 00010000:00080000:0.0:1789127076.849398:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80f00 x1876035276833664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127076.849408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276833664:0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849435:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834176 00000100:00100000:0.0:1789127076.849438:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834176 00000100:00100000:0.0:1789127076.849460:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834304 00000100:00100000:0.0:1789127076.849463:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834304 00000100:00100000:0.0:1789127076.849487:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127076.849493:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276834176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849526:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276834176:12345-0@lo:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127076.849531:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127076.849541:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127076.849546:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276834304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127076.849570:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276834304:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127076.849576:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789127076.849597:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994105018b40 x1876035276834304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127076.849604:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276834304:0@lo:400:kworker.0 00010000:00080000:0.0:1789127076.849613:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410480a1c0 x1876035276834176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127076.849626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276834176:0@lo:400:kworker.0 00000100:00080000:0.0:1789127076.849669:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127076.851069:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276833152:0@lo:8:kworker.0 00000100:00100000:3.0:1789127076.851127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127076.851164:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276833280:0@lo:8:kworker.0 00000100:00100000:3.0:1789127076.851397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127076.851414:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276833792:0@lo:8:kworker.0 00000100:00100000:3.0:1789127076.851432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.851592:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833152 00000100:00100000:0.0:1789127076.851600:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833152 00000100:00100000:0.0:1789127076.851809:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833280 00000100:00100000:0.0:1789127076.851813:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833280 00000100:00100000:2.0:1789127076.851920:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833536 00000100:00100000:2.0:1789127076.851924:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833536 00000100:00100000:2.0:1789127076.852144:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789127076.852154:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276833536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.852221:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276833536:12345-0@lo:400:kworker.0 Request processed in 69us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.852228:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127076.852760:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276833792 00000100:00100000:3.0:1789127076.852765:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276833792 00000100:00100000:3.0:1789127076.852785:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127076.852791:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276833152:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127076.852818:0:19386:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1789127076.852845:0:19386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebe59 00002000:00100000:3.0:1789127076.852859:0:19386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff994102c7d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789127076.852863:0:19386:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789127076.852865:0:19386:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127076.854520:0:19386:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789127076.854556:0:19386:0:(import.c:65:import_set_state_nolock()) ffff994102c7a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127076.854666:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276833152:12345-0@lo:8:kworker.0 Request processed in 1852us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.854988:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127076.855030:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127076.855036:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276833280:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127076.855077:0:19386:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1789127076.855104:0:19386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ebe60 00002000:00100000:3.0:1789127076.855117:0:19386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff994102c7b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789127076.855120:0:19386:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789127076.855123:0:19386:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127076.855260:0:19386:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789127076.855276:0:19386:0:(import.c:65:import_set_state_nolock()) ffff994102c7f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127076.855314:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276833280:12345-0@lo:8:kworker.0 Request processed in 277us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.855320:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127076.855333:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127076.855338:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276833792:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127076.855409:0:19386:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1789127076.855427:0:19386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ebe67 00002000:00100000:3.0:1789127076.855432:0:19386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff994102c7e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789127076.855435:0:19386:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789127076.855437:0:19386:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127076.855459:0:19386:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789127076.855470:0:19386:0:(import.c:65:import_set_state_nolock()) ffff994102c7a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127076.855499:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276833792:12345-0@lo:8:kworker.0 Request processed in 160us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.855504:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789127076.855580:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa830c0 x1876035276833152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.855593:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127076.855608:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789127076.855616:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127076.855621:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789127076.855623:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127076.855769:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127076.855776:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276833152:0@lo:8:kworker.0 00010000:00080000:3.0:1789127076.855792:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa80b40 x1876035276833280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.855800:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127076.855804:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789127076.855809:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127076.855813:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789127076.855815:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127076.855830:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127076.855834:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276833280:0@lo:8:kworker.0 00010000:00080000:3.0:1789127076.855846:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa82940 x1876035276833792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127076.855855:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789127076.855859:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127076.855861:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789127076.855863:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127076.855873:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127076.855877:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276833792:0@lo:8:kworker.0 00000004:00080000:3.0:1789127076.855959:0:18624:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789127076.855981:0:18624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276834688:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789127076.856034:0:18624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127076.856056:0:18624:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410422ab40 going to sleep for 11 seconds 00000004:00080000:3.0:1789127076.856071:0:18623:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789127076.856127:0:18623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 502060478331ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789127076.856135:0:18623:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789127076.856283:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834688 00000100:00100000:3.0:1789127076.856290:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834688 00000100:00100000:3.0:1789127076.856325:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127076.856332:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18624:x1876035276834688:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1789127076.856498:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789127076.856610:0:17901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789127076.856636:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17901:1876035276834944:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789127076.856641:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127076.856668:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276834816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127076.856762:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127076.856775:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422902bd80 going to sleep for 11 seconds 00000004:00080000:1.0:1789127076.856786:0:17900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789127076.856822:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789127076.856836:0:17900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 502061186762ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789127076.856840:0:17900:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789127076.856849:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834816 00000100:00100000:3.0:1789127076.856853:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834816 00000100:00100000:3.0:1789127076.856948:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127076.856957:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276834816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127076.856970:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127076.857015:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276834816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.857021:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789127076.857038:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789127076.857056:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043e7840 x1876035276834816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.857070:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276834816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127076.857175:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834944 00000100:00100000:0.0:1789127076.857180:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834944 00000100:00100000:0.0:1789127076.857197:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127076.857204:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17901:x1876035276834944:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789127076.857371:0:17903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789127076.857387:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17903:1876035276835200:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789127076.857415:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127076.857428:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff994206118480 going to sleep for 11 seconds 00000004:00080000:0.0:1789127076.857438:0:17902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789127076.857475:0:17902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 502061826242ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789127076.857480:0:17902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789127076.859044:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276835072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127076.859113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127076.859167:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835072 00000100:00100000:3.0:1789127076.859173:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835072 00000100:00100000:3.0:1789127076.859212:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127076.859220:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276835072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127076.859244:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127076.859283:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276835072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.859291:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789127076.859309:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789127076.859331:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043d8b40 x1876035276835072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.859349:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276835072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127076.866348:0:19941:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000004:00080000:3.0:1789127076.867254:0:18613:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789127076.869304:0:19941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789127076.869343:0:19387:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789127076.869363:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835200 00000100:00100000:2.0:1789127076.869374:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835200 00000100:00100000:2.0:1789127076.869466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276833536:0@lo:400:kworker.0 00000100:00100000:2.0:1789127076.869505:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276834560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127076.869569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.869612:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276834560 00000100:00100000:2.0:1789127076.869615:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276834560 00000100:00100000:2.0:1789127076.869638:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127076.869674:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1876035276834560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127076.869700:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127076.869744:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1876035276834560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.869752:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789127076.869780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488da40 x1876035276834560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.869795:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276834560:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1789127076.873277:0:17857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789127076.874033:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127076.874050:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17903:x1876035276835200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789127076.876813:0:19386:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789127076.876826:0:19386:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789127076.876941:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18624:x1876035276834688:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20603us (20900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.876952:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789127076.877022:0:18624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488e940 x1876035276834688/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127092 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.877037:0:18624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276834688:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789127076.877050:0:18624:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789127076.877096:0:18624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276835328:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789127076.877130:0:18624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127076.877280:0:18624:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410422ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127076.877739:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835328 00000100:00100000:2.0:1789127076.877748:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835328 00000100:00100000:2.0:1789127076.877841:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127076.877858:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18624:x1876035276835328:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789127076.877901:0:19387:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789127076.877948:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18624:x1876035276835328:12345-0@lo:5:osp-pre-1-1.0 Request processed in 92us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.877955:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:1.0:1789127076.878209:0:19388:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789127076.878215:0:19388:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789127076.878221:0:19388:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:0.0:1789127076.880708:0:20286:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789127076.880779:0:20286:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789127076.881017:0:20286:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00010000:00080000:2.0:1789127076.888222:0:18624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941030752c0 x1876035276835328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127092 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127076.888240:0:18624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030752c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276835328:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789127076.888256:0:18624:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789127076.888309:0:18624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276835456:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789127076.888377:0:18624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127076.888407:0:18624:0:(client.c:2715:ptlrpc_set_wait()) set ffff994212226f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127076.888429:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835456 00000100:00100000:2.0:1789127076.888435:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835456 00000100:00100000:2.0:1789127076.888484:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127076.888493:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18624:x1876035276835456:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789127076.888537:0:19386:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:1.0:1789127076.890217:0:17857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789127076.892325:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.892342:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.892362:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.892367:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.892374:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.892395:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.892407:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.892414:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.892440:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.892791:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.892800:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.892810:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.892816:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.892826:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.892847:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.892855:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ebe6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.892875:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.892877:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.892879:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127076.896640:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.897756:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897784:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.897789:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.897796:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897812:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897824:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897832:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897853:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.897866:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.897872:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.897880:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.897884:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.898099:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.898130:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.898138:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ebe75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.898158:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.898160:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.898162:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.900028:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.900040:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900058:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.900062:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.900068:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900093:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900104:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900113:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900138:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.900173:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.900180:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900188:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.900192:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900211:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900228:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900236:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ebe7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900255:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.900257:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.900259:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.900775:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.900782:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900791:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.900795:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.900800:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900810:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900819:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900850:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.900871:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.900899:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.900905:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900912:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.900916:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900924:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900936:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900954:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005829508c/0xa840b4da666ebe83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.900970:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.900971:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.900973:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.901389:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.901395:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901403:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.901407:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.901412:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901421:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901430:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901437:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901454:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.901461:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.901465:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901477:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.901480:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901489:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901501:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901509:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a754341a/0xa840b4da666ebe8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.901523:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.901525:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.901527:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.902026:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.902032:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902041:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.902045:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.902049:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902058:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902074:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902080:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902097:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.902393:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.902399:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902408:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.902411:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.902415:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902425:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902433:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902440:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902464:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127076.902472:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127076.902477:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902484:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.902488:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902498:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902513:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902521:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ebe91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902536:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.902540:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902546:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.902549:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902568:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902579:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902587:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ebe98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.902600:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.902601:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.902603:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.903901:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.907151:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.907162:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907180:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.907184:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.907192:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907206:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907217:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907225:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907242:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.907258:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.907263:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907271:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.907276:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907285:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907303:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907311:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb86c02e/0xa840b4da666ebe9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.907329:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.907331:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.907333:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.910843:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.910855:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.910875:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.910879:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.910886:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.910977:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.910988:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.910997:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911024:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.911038:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.911044:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911051:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.911055:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911064:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911081:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911089:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc0a0f9/0xa840b4da666ebea6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.911112:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.911113:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.911115:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.913021:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127076.914742:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.914753:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.914770:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.914774:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.914781:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.914802:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.914812:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.914818:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.914832:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127076.915062:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.915068:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915076:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.915079:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.915083:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915094:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915102:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915109:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915129:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789127076.915366:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.915372:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915380:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.915383:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.915387:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915395:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.915395:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915402:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915403:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915409:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915412:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.915416:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.915417:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127076.915426:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915445:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915453:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60b8717/0xa840b4da666ebead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915470:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127076.915474:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915480:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.915489:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915497:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915509:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915515:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025bb7811/0xa840b4da666ebeb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915529:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.915532:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915539:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.915542:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915549:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915558:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915565:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4258805/0xa840b4da666ebebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.915583:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.915584:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.915600:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.915991:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127076.916540:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.916547:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.916560:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.916564:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.916569:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.916578:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.916587:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.916602:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.916614:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.916975:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.916983:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.916992:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.916995:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.916999:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.917018:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.917026:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.917038:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.917049:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127076.917250:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127076.917257:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917265:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.917269:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917277:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917295:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917302:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8bf2099/0xa840b4da666ebec2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917318:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.917321:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917327:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.917335:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917343:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917365:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917372:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007abe3de9/0xa840b4da666ebec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.917385:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.917386:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.917388:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.917394:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.918448:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.918457:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918471:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.918475:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.918482:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918493:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918502:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918510:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918528:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.918724:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.918730:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918744:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.918748:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918756:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918774:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918781:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917e9291/0xa840b4da666ebed0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918798:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.918800:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.918801:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.918902:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.918908:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918916:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.918919:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.918923:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918933:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918947:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918954:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918967:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.918974:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.918978:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918985:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.918988:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.918996:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.919015:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.919023:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b914f39/0xa840b4da666ebed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.919037:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.919044:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.919046:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.920111:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.920119:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920132:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.920136:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.920142:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920153:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920163:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920172:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920193:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.920404:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.920410:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920419:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.920422:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.920426:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920442:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920450:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920458:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920471:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127076.920480:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127076.920485:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920492:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.920496:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920504:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920519:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920526:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab3aa99/0xa840b4da666ebede lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920550:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.920554:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920560:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.920563:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920569:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920579:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920587:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ebee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.920599:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.920600:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.920602:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.922067:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.922077:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922094:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.922107:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.922114:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922127:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922137:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922144:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922161:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.922286:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.922556:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.922739:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922749:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.922754:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922765:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922786:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922807:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5faad6/0xa840b4da666ebeec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.922828:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.922830:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.922832:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.923268:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.923275:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923286:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.923290:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.923296:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923307:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923327:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923335:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923349:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.923358:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.923364:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923371:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.923372:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.923375:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.923376:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.923379:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923383:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.923387:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.923389:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923395:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.923397:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.923405:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923407:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923414:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.923417:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.923428:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.923436:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923442:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.923445:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923452:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923462:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923469:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8a23d9/0xa840b4da666ebefa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923483:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.923485:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.923486:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.923518:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.923960:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.923966:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.923976:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.923979:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.923984:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.924004:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.924024:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.924031:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.924050:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.924085:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.924090:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924097:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.924100:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924109:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924120:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924127:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e5d729/0xa840b4da666ebf01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924141:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.924143:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.924145:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.924181:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.924186:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924195:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.924198:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.924202:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924222:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924230:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924238:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.924256:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127076.924989:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.924996:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.925004:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.925017:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.925026:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.925040:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.925047:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b910a79/0xa840b4da666ebf08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.925068:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.925070:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.925072:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.925116:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.925122:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925131:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.925134:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.925140:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925150:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925158:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925176:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925196:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.925384:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.925390:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925398:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.925401:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.925405:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925414:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925421:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925428:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925485:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789127076.925617:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.925623:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925636:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.925639:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.925643:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925669:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925678:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.925685:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926106:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127076.926113:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926121:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.926130:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926139:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926154:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926162:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c3ed348/0xa840b4da666ebf0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926176:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.926179:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926186:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.926189:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926195:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926206:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926213:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96b3477/0xa840b4da666ebf16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926231:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.926235:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926243:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.926246:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926254:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926264:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.926271:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.926273:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.926275:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.931003:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.931253:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127076.931266:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127076.932480:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.932491:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932508:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.932512:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.932519:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932549:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932560:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932567:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932590:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.932904:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.932910:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932919:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.932922:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.932926:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932936:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932945:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932966:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.932974:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127076.933025:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127076.933032:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933041:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.933046:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933056:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933077:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933085:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ebf24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933104:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.933108:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933114:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.933123:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933131:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933142:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933149:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ebf2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.933161:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.933163:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.933165:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.933402:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.933534:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.933540:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.933549:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.933553:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.933558:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.933568:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.933576:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.933584:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.933929:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.934150:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.934156:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934172:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.934176:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.934181:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934192:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934200:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934208:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127076.934264:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.934269:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934278:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.934281:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.934285:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934294:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934314:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934320:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934351:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.934359:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934366:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.934370:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934389:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934404:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934411:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9497ef6/0xa840b4da666ebf32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934428:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.934431:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934438:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.934440:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934446:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934455:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.934461:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.934463:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.934469:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.934500:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127076.934505:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934702:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.934804:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.934810:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934818:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.934821:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.934826:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934836:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934844:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934861:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.934870:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127076.935041:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.935046:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935054:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.935058:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935066:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935079:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935086:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb3af66/0xa840b4da666ebf39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935102:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.935105:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935112:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.935115:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935122:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935140:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935147:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006891b43d/0xa840b4da666ebf47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935159:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.935161:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.935163:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.935168:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.935249:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.935254:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935263:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.935267:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.935271:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935281:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935288:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935295:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935344:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.935494:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.935500:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935507:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.935510:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935518:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935529:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.935536:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f93dcf/0xa840b4da666ebf4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127076.935910:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.935916:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935930:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.935933:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.935938:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935948:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935957:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935964:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.935976:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127076.936103:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.936109:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936117:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.936120:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.936124:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936134:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936153:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936160:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936168:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127076.936297:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.936302:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936309:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.936313:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936321:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936336:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936344:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ebf55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936358:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.936362:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936368:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.936371:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936389:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936400:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936406:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a08bf45/0xa840b4da666ebf5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.936420:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.936421:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.936423:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.936429:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.936944:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.936950:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936960:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.936963:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.936968:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936979:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936988:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.936995:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.937035:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.937059:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.937064:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.937071:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.937075:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.937083:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.937095:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.937111:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eb177a/0xa840b4da666ebf63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.937125:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.937126:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.937128:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789127076.940971:0:20203:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789127076.941001:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789127076.941607:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1789127076.942347:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.942369:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.942389:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.942394:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.942402:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.942419:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.942430:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.942438:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.942458:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.943910:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.943922:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.943934:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.943939:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.943949:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.943973:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.943980:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec7e2e8c/0xa840b4da666ebf6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.944037:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.944039:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.944040:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127076.945457:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:18624:x1876035276835456:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56957us (57072us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127076.945469:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127076.945500:0:18624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789127076.945507:0:18624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18624:1876035276835456:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789127076.945523:0:18624:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789127076.945575:0:18624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18624:1876035276835584:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789127076.945630:0:18624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1789127076.945716:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.945725:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127076.945734:0:18624:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213ca7780 going to sleep for 11 seconds 00010000:00010000:0.0:1789127076.945740:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.945744:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.945751:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.945765:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.945774:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.945782:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127076.945787:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.945791:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.945798:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.945801:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.945805:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.945820:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.945827:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.945835:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127076.947744:0:17888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835584 00000100:00100000:3.0:1789127076.947756:0:17888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835584 00000100:00100000:3.0:1789127076.947820:0:17888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127076.947830:0:17888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18624:x1876035276835584:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789127076.947985:0:17888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18624:x1876035276835584:12345-0@lo:900:osp-pre-1-1.0 Request processed in 156us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127076.948057:0:17888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127076.948112:0:18624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fb8e1c0 x1876035276835584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127092 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127076.948144:0:18624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18624:1876035276835584:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789127076.949270:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789127076.950345:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.950356:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.950381:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.950385:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.950391:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.950407:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.950418:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.950425:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.950436:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789127076.950733:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127076.950742:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950751:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.950756:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950766:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950788:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950795:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4f3f01a/0xa840b4da666ebf71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950815:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.950819:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950825:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.950834:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950842:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950852:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950860:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.950863:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950868:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.950872:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950878:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950887:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950894:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e597a8a4/0xa840b4da666ebf7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.950905:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.950912:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.950913:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.950919:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127076.952767:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.952781:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.952796:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.952801:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.952807:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.952820:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.952845:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.952852:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.952874:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.953412:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.953421:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97ccdca/0xa840b4da666ebf78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954110:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.954120:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954127:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.954132:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954142:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954164:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954172:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8bf2099/0xa840b4da666ebf86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.954701:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.954704:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.954706:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127076.955048:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127076.955056:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.955081:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1789127076.955086:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.955092:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127076.955098:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.955103:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.955105:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.955112:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.955114:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127076.955115:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.955118:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.955123:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.955127:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.955143:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127076.955147:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.955153:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.955173:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789127076.955194:0:19388:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1789127076.955287:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17901:x1876035276834944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98079us (98520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127076.955297:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789127076.955321:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.955327:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955336:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.955346:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955356:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955374:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955382:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000287f029f/0xa840b4da666ebf8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955396:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.955399:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955405:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.955409:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955415:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955424:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955431:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f60b8717/0xa840b4da666ebf94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.955449:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.955451:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.955452:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127076.955493:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17901:1876035276834944:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789127076.955507:0:17901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789127076.955554:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17901:1876035276835712:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789127076.955591:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127076.955634:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942367f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127076.955639:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835712 00010000:00010000:1.0:1789127076.955645:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127076.955661:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835712 00000100:00100000:2.0:1789127076.955711:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127076.955720:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17901:x1876035276835712:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789127076.955754:0:19387:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:0.0:1789127076.956552:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.956561:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.956574:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.956577:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.956583:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.956594:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.956603:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.956610:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.959763:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127076.959803:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127076.959815:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.959828:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127076.959833:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.959852:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.959875:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.959883:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebf9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.959906:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127076.959908:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127076.959910:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127076.960618:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.960626:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.960642:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.960669:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.960677:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.960692:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.960824:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.960844:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.960996:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.961014:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.961022:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.961037:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.961040:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.961050:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.961067:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.961074:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000552e219b/0xa840b4da666ebfa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.961090:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.961092:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.961094:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.962471:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.962480:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.962493:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.962497:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.962503:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.962515:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.962525:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.962533:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.962726:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.964795:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.964807:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.964832:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.964836:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.964847:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.964990:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.965000:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21932c2/0xa840b4da666ebfa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.965034:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.965036:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.965037:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.969150:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.969166:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.969187:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.969197:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.969204:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.969220:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.969231:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.969239:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.969386:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.969997:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.970018:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.970027:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.970032:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.970041:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.970067:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.970073:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dc0a0f9/0xa840b4da666ebfb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.970091:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.970092:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.970094:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.971158:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.971168:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.971183:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.971187:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.971193:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.971207:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.971217:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.971232:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.971250:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.971288:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.971295:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.971303:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.971306:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.971314:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.971330:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.971337:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb86c02e/0xa840b4da666ebfb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.971364:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.971366:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.971367:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127076.972448:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127076.972457:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.972470:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=502s v=(0 0) 00010000:00010000:3.0:1789127076.972474:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127076.972480:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.972491:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.972500:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.972507:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.972523:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1789127076.972523:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789127076.972574:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789127076.972592:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.972599:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.972606:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.972610:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.972630:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.972672:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.972681:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099b3a100/0xa840b4da666ebfbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.972698:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.972699:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.972701:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127076.972847:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17901:x1876035276835712:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17123us (17251us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789127076.975005:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127076.975104:0:17901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789127076.975114:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17901:1876035276835712:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789127076.975137:0:17901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:0.0:1789127076.975185:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.975193:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.975414:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.975420:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.975428:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.975445:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.975456:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.975472:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.975496:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127076.977071:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.977082:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.977098:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.977103:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.977110:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.977126:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.977145:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.977153:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.977178:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127076.977298:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127076.977306:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.977314:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbe00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.977319:0:17866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.977323:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127076.977329:0:17866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.977348:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.977367:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016c8423a/0xa840b4da666ebfc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.977389:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.977391:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.977393:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.978029:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.978032:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.978034:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.978139:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.978149:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127076.978153:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.978174:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.978190:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.978199:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf532bc6/0xa840b4da666ebfcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127076.978219:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.978221:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127076.978223:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127076.981886:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.981898:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.981926:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.981930:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.981937:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.981951:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.981962:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.981970:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.981998:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127076.982553:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.982560:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.982570:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.982573:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.982577:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.982587:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.982609:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.982616:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.982641:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127076.982711:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127076.982728:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982738:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.982742:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982752:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982774:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982781:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cb092e5/0xa840b4da666ebfd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982804:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.982808:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982825:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cba00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.982829:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982836:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982859:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982866:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a681db7/0xa840b4da666ebfda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.982890:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.982891:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.982893:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.983466:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127076.984002:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127076.984022:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.984037:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789127076.984041:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127076.984048:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.984061:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.984070:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.984077:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.984122:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127076.984167:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127076.984175:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.984183:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127076.984188:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.984197:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.984224:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.984233:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16eaf39/0xa840b4da666ebfe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127076.984249:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.984252:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127076.984253:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127076.990044:0:20286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127076.990060:0:20286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.990079:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789127076.990084:0:20286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127076.990091:0:20286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.990108:0:20286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.990118:0:20286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.990126:0:20286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127076.990292:0:20286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127076.990313:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127076.990324:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.990333:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127076.990339:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.990351:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.990372:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789127076.990372:0:20286:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:1.0:1789127076.990383:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071718eee/0xa840b4da666ebfe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127076.990405:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.990408:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127076.990409:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127076.990481:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17903:x1876035276835200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 116434us (133061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127076.990491:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127076.990540:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043da1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17903:1876035276835200:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789127076.990558:0:17903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789127076.990607:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17903:1876035276835840:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789127076.990845:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127076.990884:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff994207e1dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127076.991331:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835840 00000100:00100000:0.0:1789127076.991340:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835840 00000100:00100000:0.0:1789127076.991394:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127076.991404:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17903:x1876035276835840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789127076.991445:0:19386:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1789127076.995153:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17903:x1876035276835840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3742us (4300us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789127076.995166:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127076.995243:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17903:1876035276835840:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789127076.995261:0:17903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 10000000:01000000:3.0:1789127077.355291:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127077.355301:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422035d800 from 10 10000000:01000000:3.0:1789127077.355306:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127077.355359:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.355372:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.355384:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127077.355411:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276835968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127077.355491:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127077.355540:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127077.355559:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276835968 00000100:00100000:2.0:1789127077.355572:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276835968 00000100:00100000:2.0:1789127077.355681:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789127077.355693:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276835968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127077.355716:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127077.355729:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589800/0xa840b4da666ebff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebfef expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.355761:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589800/0xa840b4da666ebff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebfef expref: 23 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.355773:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589800/0xa840b4da666ebff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebfef expref: 23 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.355783:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589800, rc 0) 00000100:00100000:2.0:1789127077.355831:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276835968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127077.355839:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789127077.355861:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276835968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127077.355877:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.355886:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127077.355935:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127077.355966:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127077.355995:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127077.356032:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836096 00000100:00100000:2.0:1789127077.356038:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836096 00000100:00100000:2.0:1789127077.356072:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127077.356079:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276836096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127077.356093:0:17872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127077.356110:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127077.356113:0:17872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789127077.356214:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276836096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127077.356222:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789127077.356224:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127077.356293:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127077.356300:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.356308:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127077.356317:0:17874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127077.356319:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9941050e6800 from 10 10000000:01000000:3.0:1789127077.356321:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127077.356343:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.356350:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.356358:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127077.356381:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127077.356408:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127077.356428:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127077.356508:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836224 00000100:00100000:2.0:1789127077.356513:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836224 00000100:00100000:2.0:1789127077.356550:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789127077.356557:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276836224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127077.356564:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127077.356571:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588600/0xa840b4da666ec004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ebffd expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.356908:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588600/0xa840b4da666ec004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ebffd expref: 24 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.356919:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588600/0xa840b4da666ec004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebffd expref: 24 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.356928:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588600, rc 0) 00000100:00100000:2.0:1789127077.356972:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276836224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 415us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127077.356978:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789127077.357052:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127077.357157:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.357165:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127077.357211:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127077.357255:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127077.357399:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127077.357410:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836352 00000100:00100000:0.0:1789127077.357415:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836352 00000100:00100000:0.0:1789127077.357449:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789127077.357456:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276836352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127077.357467:0:17870:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127077.357478:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127077.357480:0:17870:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789127077.357556:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276836352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127077.357563:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789127077.357568:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276836352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127077.357610:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127077.357617:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127077.357625:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127077.931719:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127078.955941:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127079.979231:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127080.106801:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127080.106824:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276836480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127080.106897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127080.106948:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836480 00000100:00100000:2.0:1789127080.106957:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836480 00000100:00100000:2.0:1789127080.107020:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127080.107031:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276836480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127080.107066:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127080.107113:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276836480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127080.107122:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127080.107189:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276836480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127080.620794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276836608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127080.620887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127080.621203:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836608 00000100:00100000:3.0:1789127080.621218:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836608 00000100:00100000:3.0:1789127080.621270:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127080.621281:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276836608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127080.621318:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127080.621367:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276836608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127080.621374:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127080.621419:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276836608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789127081.007618:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127081.130796:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127081.130820:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276836736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127081.130904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127081.130953:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836736 00000100:00100000:3.0:1789127081.130962:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836736 00000100:00100000:3.0:1789127081.131031:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127081.131042:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276836736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127081.131071:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127081.131117:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276836736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127081.131125:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789127081.131146:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127081.131183:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276836736:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1789127081.773453:0:20564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127082.027461:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127082.155616:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276837248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.155795:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127082.156037:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276837760:0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.156080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.158010:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276836864:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.158636:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159047:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276837376:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159190:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276837888:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159237:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276838400:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159265:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159311:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159362:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276837504:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159403:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276838016:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159442:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276838528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127082.159468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.159488:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789127082.159506:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276837120:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159635:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836864 00000100:00100000:3.0:1789127082.159644:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836864 00000100:00100000:3.0:1789127082.159709:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127082.159718:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3642:x1876035276836864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.159771:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3642:x1876035276836864:12345-0@lo:400:kworker.0 Request processed in 53us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.159779:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127082.159816:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837376 00000100:00100000:3.0:1789127082.159943:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837376 00000100:00100000:3.0:1789127082.159967:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837888 00000100:00100000:3.0:1789127082.159979:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837888 00000100:00100000:3.0:1789127082.159994:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838400 00000100:00100000:3.0:1789127082.160004:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838400 00000100:00100000:3.0:1789127082.160033:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838016 00000100:00100000:3.0:1789127082.160036:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838016 00000100:00100000:3.0:1789127082.160052:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127082.160058:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160094:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276837376:12345-0@lo:400:kworker.0 Request processed in 36us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160101:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127082.160115:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127082.160121:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276837888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160149:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276837888:12345-0@lo:400:kworker.0 Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160155:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127082.160165:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127082.160171:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276838400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160199:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276838400:12345-0@lo:400:kworker.0 Request processed in 27us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160204:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127082.160214:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127082.160220:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276838016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160245:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276838016:12345-0@lo:400:kworker.0 Request processed in 25us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160251:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127082.160278:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276836992 00000100:00100000:3.0:1789127082.160281:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276836992 00000100:00100000:3.0:1789127082.160298:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837504 00000100:00100000:3.0:1789127082.160301:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837504 00000100:00100000:3.0:1789127082.160324:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127082.160330:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276836992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160364:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276836992:12345-0@lo:400:kworker.0 Request processed in 35us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160370:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127082.160382:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127082.160388:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276837504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.160413:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276837504:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160419:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127082.160446:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838528 00000100:00100000:3.0:1789127082.160450:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838528 00000100:00100000:3.0:1789127082.160477:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127082.160483:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276838528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127082.160523:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127082.160556:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276838528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.160562:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127082.160583:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127082.160613:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.160730:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276836864:0@lo:400:kworker.0 00010000:00080000:3.0:1789127082.161054:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fb8cf00 x1876035276837376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127082.161088:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276837376:0@lo:400:kworker.0 00010000:00080000:3.0:1789127082.162032:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488e940 x1876035276837888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127082.162059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276837888:0@lo:400:kworker.0 00010000:00080000:3.0:1789127082.162076:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420aa83480 x1876035276838400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127082.162085:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276838400:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.162315:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127082.162325:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276838784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127082.162383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127082.162432:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127082.162438:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127082.162441:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127082.162455:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838656 00000100:00100000:3.0:1789127082.162460:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838656 00000100:00100000:3.0:1789127082.162508:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838784 00000100:00100000:3.0:1789127082.162512:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838784 00000100:00100000:3.0:1789127082.163961:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127082.163993:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276838656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127082.164054:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127082.164227:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276838656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 253us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.164240:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127082.164277:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127082.164285:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276838784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127082.164300:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127082.164341:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276838784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.164361:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789127082.164397:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127082.164402:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127082.164456:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127082.164507:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276838784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127082.164780:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276838272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127082.164807:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837248 00000100:00100000:2.0:1789127082.164816:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837248 00000100:00100000:3.0:1789127082.164906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.164934:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276837632:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.164961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127082.164991:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276838144:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.165019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127082.165045:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837760 00000100:00100000:2.0:1789127082.165050:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837760 00000100:00100000:3.0:1789127082.165052:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.165071:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276837504:0@lo:400:kworker.0 00000100:00100000:2.0:1789127082.165072:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837120 00000100:00100000:2.0:1789127082.165078:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837120 00010000:00080000:3.0:1789127082.165092:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488da40 x1876035276838016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127082.165093:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276837632 00000100:00100000:2.0:1789127082.165097:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276837632 00000100:00100000:2.0:1789127082.165111:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127082.165119:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276837248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.165189:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276838016:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.165210:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276838528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127082.165246:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127082.165255:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276837760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.165530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127082.165566:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127082.165575:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276837248:0@lo:400:kworker.0 00000100:00100000:0.0:1789127082.165582:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276837120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.165629:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838144 00000100:00100000:1.0:1789127082.165634:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838144 00000100:00100000:0.0:1789127082.165638:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276837120:12345-0@lo:400:kworker.0 Request processed in 62us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127082.165676:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127082.165695:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127082.165702:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838272 00000100:00100000:0.0:1789127082.165705:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276837632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.165707:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838272 00000100:00100000:1.0:1789127082.165742:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127082.165748:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276837632:12345-0@lo:400:kworker.0 Request processed in 44us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127082.165754:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276838144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127082.165761:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127082.165799:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276838144:12345-0@lo:400:kworker.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127082.165806:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127082.165923:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127082.165931:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276838272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.165967:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276838272:12345-0@lo:400:kworker.0 Request processed in 37us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127082.165985:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789127082.166003:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127082.166020:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789127082.166048:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104809a40 x1876035276838272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127082.166057:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276838272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127082.166226:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876035276837248:12345-0@lo:400:kworker.0 Request processed in 1106us (10431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127082.166235:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127082.166291:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276837760:12345-0@lo:400:kworker.0 Request processed in 1037us (10210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127082.166299:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127082.166332:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276837120:0@lo:400:kworker.0 00000100:00100000:3.0:1789127082.166349:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276837632:0@lo:400:kworker.0 00010000:00080000:3.0:1789127082.166359:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410480a1c0 x1876035276838144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127082.166368:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276838144:0@lo:400:kworker.0 00000100:00100000:1.0:1789127082.166518:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276837760:0@lo:400:kworker.0 00000040:00080000:3.0:1789127082.418815:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1789127082.675739:0:20203:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:2.0:1789127082.838360:0:20616:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127082.839455:0:20616:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127083.051467:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127083.813307:0:20666:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127083.813579:0:20666:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127084.076681:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127084.298203:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.298464:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258929920 00000100:00100000:2.0:1789127084.298476:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258929920 00000100:00100000:2.0:1789127084.298537:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1789127084.298546:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1876035258929920:12345-192.168.203.23@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789127084.298579:0:17872:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d5f1ff69-7009-445c-9381-4cde4482fa5e@192.168.203.23@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1789127084.298617:0:17872:0:(genops.c:1385:class_connect()) connect: client d5f1ff69-7009-445c-9381-4cde4482fa5e, cookie 0xa840b4da666ec00b 00000100:00080000:2.0:1789127084.298789:0:17872:0:(import.c:65:import_set_state_nolock()) ffff994103e27800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127084.298873:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+5:2390:x1876035258929920:12345-192.168.203.23@tcp:250:mount.lustre.0 Request processed in 325us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.298881:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1789127084.312077:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.312278:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930048 00000100:00100000:3.0:1789127084.312289:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930048 00000100:00100000:3.0:1789127084.312353:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1789127084.312363:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+5:15150:x1876035258930048:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789127084.312383:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127084.312403:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67c00/0xa840b4da666ec012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c767 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127084.312435:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67c00/0xa840b4da666ec012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c767 expref: 6 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127084.312447:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67c00/0xa840b4da666ec012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c767 expref: 6 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127084.312457:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67c00, rc 0) 00000100:00100000:3.0:1789127084.312535:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+6:15150:x1876035258930048:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 174us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.312543:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:1.0:1789127084.321794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.321911:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930176 00000100:00100000:0.0:1789127084.321922:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930176 00000100:00100000:0.0:1789127084.322001:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:0.0:1789127084.322013:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+6:15150:x1876035258930176:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127084.322144:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+6:15150:x1876035258930176:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 132us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127084.322164:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:1.0:1789127084.324564:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.325292:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930304 00000100:00100000:2.0:1789127084.325305:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930304 00000100:00100000:2.0:1789127084.325370:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:2.0:1789127084.325381:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+6:15150:x1876035258930304:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127084.325399:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127084.325421:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588200/0xa840b4da666ec019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c76e expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.325453:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588200/0xa840b4da666ec019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c76e expref: 7 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.325465:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588200/0xa840b4da666ec019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c76e expref: 7 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.325476:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588200, rc 0) 00000100:00100000:2.0:1789127084.326281:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+7:15150:x1876035258930304:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 896us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.326292:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:2.0:1789127084.335924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.336026:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930432 00000100:00100000:3.0:1789127084.336037:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930432 00000100:00100000:3.0:1789127084.336115:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:3.0:1789127084.336126:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+7:15150:x1876035258930432:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127084.336303:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15150:x1876035258930432:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 178us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.336313:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:1.0:1789127084.348820:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.349029:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930560 00000100:00100000:2.0:1789127084.349042:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930560 00000100:00100000:2.0:1789127084.349123:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:2.0:1789127084.349135:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15150:x1876035258930560:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789127084.349680:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15150:x1876035258930560:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 515us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.349689:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:2.0:1789127084.353821:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.355438:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930688 00000100:00100000:0.0:1789127084.355572:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930688 00000100:00100000:0.0:1789127084.355642:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:0.0:1789127084.355671:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930688:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127084.359437:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930688:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 3757us (5614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.359529:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:3.0:1789127084.413025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.414600:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930816 00000100:00100000:2.0:1789127084.414618:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930816 00000100:00100000:2.0:1789127084.414739:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1789127084.414752:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930816:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127084.415539:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930816:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 774us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.415550:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:1.0:1789127084.426853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.426968:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258930944 00000100:00100000:0.0:1789127084.426989:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258930944 00000100:00100000:0.0:1789127084.427054:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:0.0:1789127084.427063:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930944:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127084.427230:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15168:x1876035258930944:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 166us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.427238:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:1.0:1789127084.439751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.440443:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931072 00000100:00100000:2.0:1789127084.440455:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931072 00000100:00100000:2.0:1789127084.440515:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:2.0:1789127084.440524:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:15150:x1876035258931072:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127084.440543:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127084.440564:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589000/0xa840b4da666ec020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c79f expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.440600:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589000/0xa840b4da666ec020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c79f expref: 9 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.440613:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589000/0xa840b4da666ec020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c79f expref: 9 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.440623:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589000, rc 0) 00000100:00100000:2.0:1789127084.440736:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:15150:x1876035258931072:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 211us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.440744:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:2.0:1789127084.447546:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.447747:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931200 00000100:00100000:3.0:1789127084.447758:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931200 00000100:00100000:3.0:1789127084.447979:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:3.0:1789127084.447990:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:15150:x1876035258931200:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789127084.448311:0:17870:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789127084.448334:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789127084.448338:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789127084.448341:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789127084.448344:0:17870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789127084.448347:0:17870:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789127084.452384:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:15150:x1876035258931200:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 4381us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.452403:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1789127084.458545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.459454:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931328 00000100:00100000:0.0:1789127084.459467:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931328 00000100:00100000:0.0:1789127084.459535:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:0.0:1789127084.459547:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:15150:x1876035258931328:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127084.459567:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127084.459589:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c7a6 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127084.459620:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 10 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127084.459632:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 10 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127084.459641:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:0.0:1789127084.459916:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15150:x1876035258931328:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 370us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.459932:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:2.0:1789127084.463674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.463756:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931456 00000100:00100000:3.0:1789127084.464166:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931456 00000100:00100000:3.0:1789127084.464237:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:3.0:1789127084.464250:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15150:x1876035258931456:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789127084.464460:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15150:x1876035258931456:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 213us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.464469:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:1.0:1789127084.467672:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.467984:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931584 00000100:00100000:0.0:1789127084.467993:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931584 00000100:00100000:0.0:1789127084.468059:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:0.0:1789127084.468069:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15150:x1876035258931584:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127084.468268:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15150:x1876035258931584:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 199us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.468277:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:1.0:1789127084.472839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.473325:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931712 00000100:00100000:2.0:1789127084.473338:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931712 00000100:00100000:2.0:1789127084.473445:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1789127084.473457:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15175:x1876035258931712:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127084.473685:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15175:x1876035258931712:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 229us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.473694:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:3.0:1789127084.476812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.486595:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931840 00000100:00100000:0.0:1789127084.486612:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931840 00000100:00100000:0.0:1789127084.486936:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:0.0:1789127084.487053:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15175:x1876035258931840:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127084.487233:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15175:x1876035258931840:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 286us (10443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.487246:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:1.0:1789127084.513754:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127084.513815:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.513972:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258931968 00000100:00100000:2.0:1789127084.513983:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258931968 00000100:00100000:2.0:1789127084.514037:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932224 00000100:00100000:2.0:1789127084.514040:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932224 00000100:00100000:2.0:1789127084.514071:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127084.514080:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1876035258931968:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789127084.514116:0:19940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 51fd9021-bb15-44c1-9135-323c18d5cef9@192.168.203.23@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1789127084.514189:0:19940:0:(genops.c:1385:class_connect()) connect: client 51fd9021-bb15-44c1-9135-323c18d5cef9, cookie 0xa840b4da666ec02e 00000004:00100000:2.0:1789127084.514221:0:19940:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789127084.514472:0:19940:0:(import.c:65:import_set_state_nolock()) ffff994103e23000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127084.514551:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2390:x1876035258931968:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 470us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.514560:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127084.514583:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789127084.514589:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1876035258932224:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789127084.514608:0:19940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 51fd9021-bb15-44c1-9135-323c18d5cef9@192.168.203.23@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1789127084.514688:0:19940:0:(genops.c:1385:class_connect()) connect: client 51fd9021-bb15-44c1-9135-323c18d5cef9, cookie 0xa840b4da666ec035 00000004:00100000:2.0:1789127084.514703:0:19940:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789127084.515358:0:19940:0:(import.c:65:import_set_state_nolock()) ffff994103e20800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127084.515413:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2390:x1876035258932224:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 822us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.518455:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:1.0:1789127084.529595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127084.529712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.531377:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932480 00000100:00100000:3.0:1789127084.531393:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932480 00000100:00100000:3.0:1789127084.531487:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932096 00000100:00100000:3.0:1789127084.531491:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932096 00000100:00100000:3.0:1789127084.531515:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789127084.531526:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15150:x1876035258932480:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127084.531577:0:17875:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127084.531735:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15150:x1876035258932480:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 209us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.531743:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789127084.531773:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789127084.531781:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:0:x1876035258932096:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127084.531793:0:17875:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127084.531859:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:0:x1876035258932096:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 78us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.531866:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:1.0:1789127084.532126:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127084.544625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127084.544775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.558463:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932608 00000100:00100000:3.0:1789127084.558484:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932608 00000100:00100000:2.0:1789127084.558794:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932352 00000100:00100000:2.0:1789127084.558800:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932352 00000100:00100000:2.0:1789127084.558851:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789127084.558861:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258932608:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789127084.558984:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258932608:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 123us (14374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.558991:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789127084.559026:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1789127084.559033:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:0:x1876035258932352:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127084.559062:0:17875:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127084.559117:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:0:x1876035258932352:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 84us (14343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.559124:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00080000:3.0:1789127084.559209:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127084.568799:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.568846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.568873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127084.568973:0:17887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932992 00000100:00100000:3.0:1789127084.568985:0:17887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932992 00000100:00100000:3.0:1789127084.569059:0:17887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1789127084.569071:0:17887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258932992:12345-192.168.203.23@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789127084.569173:0:17887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258932992:12345-192.168.203.23@tcp:900:mount.lustre.0 Request processed in 104us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127084.569202:0:17887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1789127084.569807:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932736 00000100:00100000:0.0:1789127084.569814:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932736 00000100:00100000:0.0:1789127084.569849:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258932864 00000100:00100000:0.0:1789127084.569852:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258932864 00000100:00100000:0.0:1789127084.569880:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789127084.569886:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1876035258932736:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127084.569919:0:19387:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 51fd9021-bb15-44c1-9135-323c18d5cef9@192.168.203.23@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1789127084.569972:0:19387:0:(genops.c:1385:class_connect()) connect: client 51fd9021-bb15-44c1-9135-323c18d5cef9, cookie 0xa840b4da666ec03c 00002000:00100000:0.0:1789127084.569988:0:19387:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 51fd9021-bb15-44c1-9135-323c18d5cef9/ffff994102cc2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127084.570022:0:19387:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789127084.570199:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789127084.570206:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1876035258932864:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789127084.570227:0:19941:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 51fd9021-bb15-44c1-9135-323c18d5cef9@192.168.203.23@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1789127084.570248:0:19941:0:(genops.c:1385:class_connect()) connect: client 51fd9021-bb15-44c1-9135-323c18d5cef9, cookie 0xa840b4da666ec043 00002000:00100000:1.0:1789127084.570254:0:19941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 51fd9021-bb15-44c1-9135-323c18d5cef9/ffff9941030ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127084.570279:0:19941:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127084.570467:0:19941:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789127084.570505:0:19941:0:(import.c:65:import_set_state_nolock()) ffff9941030cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127084.570575:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2390:x1876035258932864:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 367us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127084.570583:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00002000:00080000:0.0:1789127084.571321:0:19387:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127084.571354:0:19387:0:(import.c:65:import_set_state_nolock()) ffff994102cc1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127084.571400:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2390:x1876035258932736:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1512us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.571409:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789127084.575170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127084.575499:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933120 00000100:00100000:0.0:1789127084.575510:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933120 00000100:00100000:0.0:1789127084.575575:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789127084.575586:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258933120:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789127084.578010:0:17879:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2258us 00000004:00200000:0.0:1789127084.594263:0:17879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789127084.594441:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15150:x1876035258933120:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 18849us (19278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127084.594455:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127084.779907:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127084.780581:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933248 00000100:00100000:2.0:1789127084.780593:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933248 00000100:00100000:2.0:1789127084.780720:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1789127084.780731:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15199:x1876035258933248:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:2.0:1789127084.780756:0:17875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127084.780869:0:17875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec04a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c7d7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.780965:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.780979:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.781004:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127084.781068:0:17875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127084.781073:0:17875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127084.781185:0:17875:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.781218:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec04a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7d7 expref: 8 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.781241:0:17875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7d7 expref: 7 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127084.781251:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:2.0:1789127084.781254:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127084.781258:0:17875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588400, rc 0) 00000100:00100000:2.0:1789127084.781392:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15199:x1876035258933248:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 663us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127084.781400:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00010000:00010000:1.0:1789127085.101317:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127085.226969:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127085.227000:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276838912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127085.227082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127085.228356:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276838912 00000100:00100000:0.0:1789127085.228368:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276838912 00000100:00100000:0.0:1789127085.228442:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789127085.228452:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276838912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127085.228490:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789127085.228559:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276838912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127085.228567:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127085.230123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276838912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127085.739077:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127085.739129:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276839040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127085.739215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127085.739625:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839040 00000100:00100000:0.0:1789127085.739634:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839040 00000100:00100000:0.0:1789127085.739732:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127085.739742:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276839040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127085.739793:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789127085.739869:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276839040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127085.739877:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127085.740120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276839040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127086.128883:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127086.251834:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276839168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127086.251941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127086.252265:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839168 00000100:00100000:3.0:1789127086.252275:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839168 00000100:00100000:3.0:1789127086.252358:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127086.252368:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276839168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127086.252405:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127086.252471:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276839168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127086.252479:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789127086.253280:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127086.253467:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276839168:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789127086.384612:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127086.913444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127086.913559:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933376 00000100:00100000:2.0:1789127086.913573:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933376 00000100:00100000:2.0:1789127086.913749:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1789127086.913762:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15253:x1876035258933376:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:2.0:1789127086.913811:0:17876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127086.913932:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15253:x1876035258933376:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 172us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127086.913954:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00080000:1.0:1789127086.915462:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127086.923380:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127086.923579:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933504 00000100:00100000:0.0:1789127086.923598:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933504 00000100:00100000:0.0:1789127086.923727:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1789127086.923739:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933504:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:0.0:1789127086.923793:0:17875:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789127086.923902:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933504:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 165us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127086.923910:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00080000:1.0:1789127086.924244:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127086.929371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127086.929527:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933632 00000100:00100000:3.0:1789127086.929539:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933632 00000100:00100000:3.0:1789127086.929737:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789127086.930081:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933632:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:3.0:1789127086.930117:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127086.930265:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933632:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 519us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127086.930282:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:1.0:1789127086.930955:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127086.934590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127086.935407:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933760 00000100:00100000:2.0:1789127086.935421:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933760 00000100:00100000:2.0:1789127086.935516:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789127086.935528:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933760:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:2.0:1789127086.935572:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127086.935708:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15253:x1876035258933760:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 182us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127086.935717:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00080000:1.0:1789127086.935922:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789127087.147634:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127087.181797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.181931:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258933888 00000100:00100000:0.0:1789127087.181955:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258933888 00000100:00100000:0.0:1789127087.182031:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:0.0:1789127087.182042:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:15285:x1876035258933888:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127087.182071:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127087.182095:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca600/0xa840b4da666ec058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c7de expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.182128:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca600/0xa840b4da666ec058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7de expref: 11 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.182151:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca600/0xa840b4da666ec058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7de expref: 11 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.182184:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca600, rc 0) 00000100:00100000:0.0:1789127087.182257:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258933888:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 217us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.182266:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:0.0:1789127087.200825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.201420:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934016 00000100:00100000:1.0:1789127087.201435:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934016 00000100:00100000:1.0:1789127087.201502:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:1.0:1789127087.201514:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258934016:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127087.201751:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258934016:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 238us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.201759:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:1.0:1789127087.221642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.221884:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934144 00000100:00100000:0.0:1789127087.221896:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934144 00000100:00100000:0.0:1789127087.221987:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1789127087.222004:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258934144:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127087.222208:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258934144:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 211us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.222217:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:3.0:1789127087.274975:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127087.275006:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276839296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127087.275103:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127087.275186:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839296 00000100:00100000:3.0:1789127087.275194:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839296 00000100:00100000:3.0:1789127087.275256:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127087.275266:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276839296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127087.275291:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127087.275358:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276839296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.275367:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789127087.275393:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127087.275432:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276839296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127087.277219:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127087.277248:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276839424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127087.277333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127087.277406:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839424 00000100:00100000:2.0:1789127087.277414:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839424 00000100:00100000:2.0:1789127087.277472:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127087.277482:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276839424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127087.277505:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127087.277547:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276839424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127087.277555:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789127087.277575:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127087.277607:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276839424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127087.279235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127087.280037:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276839552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127087.280118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127087.280362:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839552 00000100:00100000:3.0:1789127087.280370:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839552 00000100:00100000:3.0:1789127087.280435:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127087.280446:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276839552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127087.280473:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127087.280523:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276839552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.280531:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127087.280821:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276839936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.280862:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.280884:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276840448:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.280907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.280930:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789127087.280948:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276839808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.280997:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.281026:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276840320:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281049:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.281078:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276840832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.281150:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839936 00000100:00100000:0.0:1789127087.281155:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839936 00000100:00100000:0.0:1789127087.281180:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840448 00000100:00100000:0.0:1789127087.281183:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840448 00000100:00100000:0.0:1789127087.281198:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840320 00000100:00100000:0.0:1789127087.281201:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840320 00000100:00100000:0.0:1789127087.281212:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840832 00000100:00100000:0.0:1789127087.281214:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840832 00000100:00100000:0.0:1789127087.281227:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127087.281235:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276839936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281277:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276839936:12345-0@lo:400:kworker.0 Request processed in 42us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281283:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127087.281298:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127087.281304:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276840448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281331:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276840448:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281336:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127087.281347:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127087.281353:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281378:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276840320:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281384:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127087.281396:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127087.281402:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276840832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281430:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876035276840832:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281446:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127087.281473:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934272 00000100:00100000:0.0:1789127087.281477:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934272 00000100:00100000:0.0:1789127087.281506:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:0.0:1789127087.281513:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934272:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127087.281692:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934272:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 178us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281700:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:0.0:1789127087.281732:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839808 00000100:00100000:0.0:1789127087.281736:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839808 00000100:00100000:0.0:1789127087.281762:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127087.281768:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281806:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276839808:12345-0@lo:400:kworker.0 Request processed in 37us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.281812:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127087.281858:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276839808:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281871:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276840320:0@lo:400:kworker.0 00010000:00080000:0.0:1789127087.281884:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec2d00 x1876035276840832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127087.281894:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276840832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281903:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276839936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276840448:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.281965:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276839680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.282032:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276840192:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.282075:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276840704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.282118:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789127087.282124:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276840064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.282161:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276840576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127087.282205:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840704 00000100:00100000:0.0:1789127087.282209:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840704 00000100:00100000:0.0:1789127087.282231:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840576 00000100:00100000:0.0:1789127087.282233:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840576 00000100:00100000:0.0:1789127087.282247:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127087.282253:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282289:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276840704:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.282294:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127087.282305:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127087.282311:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282335:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276840576:12345-0@lo:400:kworker.0 Request processed in 23us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.282341:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127087.282357:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840064 00000100:00100000:0.0:1789127087.282361:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840064 00000100:00100000:0.0:1789127087.282385:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127087.282390:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276840064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282418:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276840064:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.282423:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127087.282446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276840064:0@lo:400:kworker.0 00010000:00080000:0.0:1789127087.282456:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994103ec0f00 x1876035276840576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127087.282464:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276840576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282473:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276840704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282499:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276839680 00000100:00100000:0.0:1789127087.282502:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276839680 00000100:00100000:0.0:1789127087.282528:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789127087.282534:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276839680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127087.282567:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276839680:12345-0@lo:400:kworker.0 Request processed in 33us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.282573:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789127087.282601:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276839680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127087.285697:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840192 00000100:00100000:3.0:1789127087.285715:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840192 00000100:00100000:3.0:1789127087.285801:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127087.285812:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127087.285908:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276840192:12345-0@lo:400:kworker.0 Request processed in 99us (3849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.285916:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789127087.286171:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127087.286178:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127087.286182:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127087.286221:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789127087.286253:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276839552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127087.291139:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276840192:0@lo:400:kworker.0 00000100:00100000:2.0:1789127087.335359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.335451:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934400 00000100:00100000:0.0:1789127087.335463:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934400 00000100:00100000:0.0:1789127087.335530:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:0.0:1789127087.335541:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934400:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127087.335748:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934400:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 209us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.335763:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:1.0:1789127087.354790:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127087.355282:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934528 00000100:00100000:2.0:1789127087.355295:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934528 00000100:00100000:2.0:1789127087.355372:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:2.0:1789127087.355389:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934528:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127087.355622:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15292:x1876035258934528:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 236us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127087.355632:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:1.0:1789127087.361981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127087.362325:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934656 00000100:00100000:2.0:1789127087.362337:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934656 00000100:00100000:2.0:1789127087.362402:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:2.0:1789127087.362412:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15285:x1876035258934656:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127087.362432:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127087.362451:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589e00/0xa840b4da666ec05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c80f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127087.365340:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589e00/0xa840b4da666ec05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c80f expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127087.365370:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589e00/0xa840b4da666ec05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c80f expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127087.365383:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589e00, rc 0) 00000100:00100000:2.0:1789127087.365487:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15285:x1876035258934656:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 3069us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127087.365504:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:3.0:1789127087.370769:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.370950:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934784 00000100:00100000:0.0:1789127087.370963:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934784 00000100:00100000:0.0:1789127087.371037:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:0.0:1789127087.371048:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15285:x1876035258934784:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789127087.371081:0:17872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789127087.371116:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789127087.371121:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789127087.371124:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789127087.371128:0:17872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789127087.371130:0:17872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789127087.380009:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15285:x1876035258934784:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 8949us (9239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.380027:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:2.0:1789127087.385886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.386441:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258934912 00000100:00100000:0.0:1789127087.386455:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258934912 00000100:00100000:0.0:1789127087.386752:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:0.0:1789127087.386772:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15285:x1876035258934912:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127087.386792:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127087.386812:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c816 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.386842:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.386854:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.386886:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca200, rc 0) 00000100:00100000:0.0:1789127087.386965:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15285:x1876035258934912:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 197us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.386972:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:3.0:1789127087.395310:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.395445:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935040 00000100:00100000:0.0:1789127087.395457:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935040 00000100:00100000:0.0:1789127087.395593:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:0.0:1789127087.395604:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15285:x1876035258935040:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127087.396136:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15285:x1876035258935040:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 532us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.396145:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:2.0:1789127087.400846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.401284:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935168 00000100:00100000:0.0:1789127087.401295:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935168 00000100:00100000:0.0:1789127087.401402:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:0.0:1789127087.401413:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15285:x1876035258935168:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127087.401714:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15285:x1876035258935168:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 303us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.401724:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:2.0:1789127087.405242:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.405994:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935296 00000100:00100000:1.0:1789127087.406007:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935296 00000100:00100000:1.0:1789127087.406081:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:1.0:1789127087.406092:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15297:x1876035258935296:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127087.406311:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15297:x1876035258935296:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 221us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.406320:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:3.0:1789127087.419730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.420630:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935424 00000100:00100000:0.0:1789127087.420642:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935424 00000100:00100000:0.0:1789127087.420740:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:0.0:1789127087.420751:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15297:x1876035258935424:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127087.421747:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15297:x1876035258935424:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 991us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.421779:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:3.0:1789127087.430439:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127087.430476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127087.430553:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127087.430579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.430594:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935552 00000100:00100000:0.0:1789127087.430608:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935552 00000100:00100000:3.0:1789127087.430626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127087.430665:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.430676:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935808 00000100:00100000:0.0:1789127087.430682:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935808 00000100:00100000:3.0:1789127087.430688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.430695:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936320 00000100:00100000:0.0:1789127087.430700:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936320 00000100:00100000:3.0:1789127087.430715:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936576 00000100:00100000:3.0:1789127087.430720:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936576 00000100:00100000:0.0:1789127087.430732:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936192 00000100:00100000:0.0:1789127087.430737:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936192 00000100:00100000:3.0:1789127087.430755:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936448 00000100:00100000:3.0:1789127087.430760:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936448 00000100:00100000:0.0:1789127087.430766:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:0.0:1789127087.430779:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936320:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127087.430797:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1789127087.430807:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936576:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127087.431502:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789127087.431517:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2393:x1876035258936192:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127087.431570:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2393:x1876035258936192:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 58us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.431596:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789127087.431604:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1876035258935552:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789127087.431641:0:17877:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 85b3b52e-7532-42e2-9665-c726ed80b63f@192.168.203.23@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1789127087.431704:0:17877:0:(genops.c:1385:class_connect()) connect: client 85b3b52e-7532-42e2-9665-c726ed80b63f, cookie 0xa840b4da666ec06d 00000004:00100000:1.0:1789127087.431736:0:17877:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789127087.431752:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789127087.431775:0:17876:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00080000:1.0:1789127087.431971:0:17877:0:(import.c:65:import_set_state_nolock()) ffff9941030c8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127087.432009:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2390:x1876035258935552:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 404us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.432017:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789127087.432033:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789127087.432038:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1876035258935808:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789127087.432054:0:17877:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 85b3b52e-7532-42e2-9665-c726ed80b63f@192.168.203.23@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1789127087.432079:0:17877:0:(genops.c:1385:class_connect()) connect: client 85b3b52e-7532-42e2-9665-c726ed80b63f, cookie 0xa840b4da666ec074 00000004:00100000:1.0:1789127087.432091:0:17877:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789127087.432138:0:17877:0:(import.c:65:import_set_state_nolock()) ffff9942064b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127087.432170:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2390:x1876035258935808:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 131us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.432177:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789127087.432234:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:1.0:1789127087.432243:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936448:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127087.432272:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936448:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.432279:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:1.0:1789127087.432326:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936064 00000100:00100000:1.0:1789127087.432331:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936064 00000100:00100000:1.0:1789127087.432362:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:1.0:1789127087.432368:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258936064:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127087.432390:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258936064:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.432395:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:2.0:1789127087.432456:0:17876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789127087.433273:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936320:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 255us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.433283:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789127087.433625:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258936576:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.433635:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127087.434997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.435094:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936704 00000100:00100000:1.0:1789127087.435102:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936704 00000100:00080000:2.0:1789127087.435166:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127087.435175:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1789127087.435185:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258936704:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789127087.435217:0:17877:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127087.435298:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258936704:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.435305:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1789127087.435558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127087.435631:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935936 00000100:00100000:2.0:1789127087.435637:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935936 00000100:00100000:1.0:1789127087.435707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127087.435908:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258935680 00000100:00100000:2.0:1789127087.435913:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258935680 00000100:00080000:0.0:1789127087.435970:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127087.436573:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789127087.436587:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:0:x1876035258935936:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127087.436612:0:20680:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127087.436702:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:0:x1876035258935936:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 119us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.436710:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789127087.436729:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1789127087.436735:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:0:x1876035258935680:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127087.436746:0:20680:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127087.436770:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:0:x1876035258935680:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 35us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.436776:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789127087.437451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.437489:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936832 00000100:00100000:0.0:1789127087.437495:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936832 00000100:00100000:0.0:1789127087.437537:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789127087.437546:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258936832:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789127087.437599:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258936832:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.437606:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1789127087.444288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.444327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.444359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127087.444446:0:17887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937216 00000100:00100000:3.0:1789127087.444475:0:17887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937216 00000100:00100000:3.0:1789127087.444542:0:17887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789127087.444553:0:17887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258937216:12345-192.168.203.23@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789127087.444679:0:17887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258937216:12345-192.168.203.23@tcp:900:mount.lustre.0 Request processed in 98us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127087.444687:0:17887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1789127087.444830:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258936960 00000100:00100000:2.0:1789127087.444836:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258936960 00000100:00100000:2.0:1789127087.444868:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937088 00000100:00100000:2.0:1789127087.445620:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937088 00000100:00100000:0.0:1789127087.445875:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1789127087.445883:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1876035258936960:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127087.445917:0:19387:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 85b3b52e-7532-42e2-9665-c726ed80b63f@192.168.203.23@tcp t0 exp 0000000000000000 cur 512 last 0 00000100:00100000:2.0:1789127087.446206:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1789127087.446212:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1876035258937088:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789127087.446231:0:19941:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 85b3b52e-7532-42e2-9665-c726ed80b63f@192.168.203.23@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1789127087.446289:0:19941:0:(genops.c:1385:class_connect()) connect: client 85b3b52e-7532-42e2-9665-c726ed80b63f, cookie 0xa840b4da666ec07b 00002000:00100000:2.0:1789127087.446304:0:19941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85b3b52e-7532-42e2-9665-c726ed80b63f/ffff994220b33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127087.446319:0:19941:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127087.446422:0:19941:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789127087.446458:0:19941:0:(import.c:65:import_set_state_nolock()) ffff994220b34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127087.446518:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2390:x1876035258937088:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 304us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127087.446526:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000020:00000080:0.0:1789127087.447121:0:19387:0:(genops.c:1385:class_connect()) connect: client 85b3b52e-7532-42e2-9665-c726ed80b63f, cookie 0xa840b4da666ec082 00002000:00100000:0.0:1789127087.447147:0:19387:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85b3b52e-7532-42e2-9665-c726ed80b63f/ffff994102cc7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127087.447155:0:19387:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127087.447215:0:19387:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127087.447237:0:19387:0:(import.c:65:import_set_state_nolock()) ffff994102f32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127087.447270:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2390:x1876035258936960:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1387us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.447280:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1789127087.449759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127087.450013:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937344 00000100:00100000:1.0:1789127087.450024:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937344 00000100:00100000:1.0:1789127087.450209:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1789127087.450221:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258937344:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789127087.450339:0:17880:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789127087.450581:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15285:x1876035258937344:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 362us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127087.450589:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1789127087.593011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127087.593217:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937472 00000100:00100000:0.0:1789127087.593228:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937472 00000100:00100000:0.0:1789127087.593296:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1789127087.593306:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15322:x1876035258937472:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:0.0:1789127087.593332:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127087.593361:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c847 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593440:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593456:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593468:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127087.593524:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127087.593528:0:19940:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127087.593551:0:19940:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593604:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 8 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593627:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 7 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127087.593636:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:0.0:1789127087.593639:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127087.593643:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cba00, rc 0) 00000100:00100000:0.0:1789127087.593798:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+7:15322:x1876035258937472:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 493us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127087.593807:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00010000:00010000:1.0:1789127088.171153:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127089.196587:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127090.221270:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127090.347067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276840960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127090.347160:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127090.347337:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276840960 00000100:00100000:2.0:1789127090.347346:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276840960 00000100:00100000:2.0:1789127090.347408:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127090.347418:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276840960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127090.347461:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127090.347517:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276840960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127090.347524:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127090.347575:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276840960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127090.861548:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127090.861577:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127090.861684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127090.862153:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841088 00000100:00100000:2.0:1789127090.862161:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841088 00000100:00100000:2.0:1789127090.862225:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127090.862235:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127090.862285:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127090.862350:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127090.862358:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127090.862948:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841088:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1789127090.864130:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:2.0:1789127090.864143:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:00100000:1.0:1789127090.865777:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:1.0:1789127090.865795:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:00100000:1.0:1789127090.867230:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:1.0:1789127090.867245:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:00100000:3.0:1789127090.868296:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:3.0:1789127090.868311:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:02000400:1.0:1789127091.235441:0:20765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789127091.242966:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127091.372946:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276841216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127091.373049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127091.373210:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841216 00000100:00100000:3.0:1789127091.373219:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841216 00000100:00100000:3.0:1789127091.373288:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127091.373300:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276841216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127091.373335:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127091.373386:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276841216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127091.373393:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789127091.373452:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127091.373497:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276841216:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127092.269200:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127092.395541:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276841472:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.395586:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789127092.395645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.395663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.395723:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276841856:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.395767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.395787:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276842368:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.395812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.395830:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276842880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.395854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.395949:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841856 00000100:00100000:3.0:1789127092.395957:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841856 00000100:00100000:3.0:1789127092.396001:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842368 00000100:00100000:3.0:1789127092.396005:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842368 00000100:00100000:3.0:1789127092.396027:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842880 00000100:00100000:3.0:1789127092.396030:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842880 00000100:00100000:3.0:1789127092.396060:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127092.396069:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276841856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.396120:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276841856:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.396129:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127092.396149:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127092.396156:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276842368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.396185:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276842368:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.396191:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127092.396204:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127092.396212:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276842880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.396242:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276842880:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.396248:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789127092.396280:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127092.396315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276841856:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.396327:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276842368:0@lo:400:kworker.0 00010000:00080000:3.0:1789127092.396339:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410406bc00 x1876035276842880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127092.396350:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276842880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.396449:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127092.396461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276843008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127092.396495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.396531:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843008 00000100:00100000:3.0:1789127092.396534:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843008 00000100:00100000:3.0:1789127092.396572:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127092.396580:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276843008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127092.396607:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127092.396804:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276843008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.396813:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789127092.396838:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127092.397119:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276843008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127092.397204:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841472 00000100:00100000:3.0:1789127092.397209:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841472 00000100:00100000:3.0:1789127092.397248:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127092.397257:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276841472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397309:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276841472:12345-0@lo:400:kworker.0 Request processed in 54us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.397327:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127092.397351:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841344 00000100:00100000:3.0:1789127092.397419:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841344 00000100:00100000:3.0:1789127092.397452:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789127092.397460:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3641:x1876035276841344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397499:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3641:x1876035276841344:12345-0@lo:400:kworker.0 Request processed in 41us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.397506:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789127092.397538:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841728:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397591:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276842240:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397629:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104068f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276842752:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397712:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789127092.397719:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841600:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397766:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276842112:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397806:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276842624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.397824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127092.397848:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841728 00000100:00100000:3.0:1789127092.397851:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841728 00000100:00100000:3.0:1789127092.397881:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842240 00000100:00100000:3.0:1789127092.397884:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842240 00000100:00100000:3.0:1789127092.397920:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841600 00000100:00100000:3.0:1789127092.397923:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841600 00000100:00100000:3.0:1789127092.397939:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842112 00000100:00100000:3.0:1789127092.397941:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842112 00000100:00100000:3.0:1789127092.397959:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127092.397966:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398004:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841728:12345-0@lo:400:kworker.0 Request processed in 38us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398010:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127092.398024:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127092.398031:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276842240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398059:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276842240:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398067:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127092.398081:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127092.398088:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398118:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276841600:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398124:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127092.398136:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127092.398143:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276842112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398171:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276842112:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398177:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127092.398211:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842752 00000100:00100000:3.0:1789127092.398215:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842752 00000100:00100000:3.0:1789127092.398238:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842624 00000100:00100000:3.0:1789127092.398247:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842624 00000100:00100000:3.0:1789127092.398272:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127092.398280:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276842752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398316:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276842752:12345-0@lo:400:kworker.0 Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398322:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127092.398336:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789127092.398343:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276842624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398408:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276842624:12345-0@lo:400:kworker.0 Request processed in 66us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398416:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789127092.398421:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127092.398426:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127092.398429:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127092.398430:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127092.398451:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841600:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276842112:0@lo:400:kworker.0 00010000:00080000:3.0:1789127092.398481:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040683c0 x1876035276842624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127092.398484:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276841344:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398498:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276842624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398516:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276841728:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398527:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276842240:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.398538:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104068f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276842752:0@lo:400:kworker.0 00000100:00100000:2.0:1789127092.398682:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276843136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127092.398712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127092.398734:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127092.398755:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276843264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127092.398768:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843136 00000100:00100000:3.0:1789127092.398773:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843136 00000100:00100000:3.0:1789127092.398802:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127092.398809:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276843136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127092.398822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789127092.398838:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127092.398882:0:19389:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789127092.398890:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276843136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398897:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127092.398914:0:19389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789127092.398919:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843264 00000100:00100000:3.0:1789127092.398924:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843264 00000100:00100000:3.0:1789127092.398940:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127092.398947:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276843264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127092.398958:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127092.398988:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276843264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.398995:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127092.399034:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276843264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127092.399047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276843136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127092.400085:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276841472:0@lo:400:kworker.0 00000100:00100000:0.0:1789127092.400099:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276841984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127092.401005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127092.401081:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276841984 00000100:00100000:0.0:1789127092.401089:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276841984 00000100:00100000:2.0:1789127092.401158:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276842496:0@lo:400:kworker.0 00000100:00100000:2.0:1789127092.401195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127092.401210:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127092.401223:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276841984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.401226:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276842496 00000100:00100000:3.0:1789127092.401232:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276842496 00000100:00100000:3.0:1789127092.401288:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127092.401295:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276841984:12345-0@lo:400:kworker.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.401300:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276842496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127092.401308:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127092.401352:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276842496:12345-0@lo:400:kworker.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127092.401355:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276841984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127092.401383:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276842496:0@lo:400:kworker.0 00000100:00100000:3.0:1789127092.401435:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789127092.401460:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127092.562173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562225:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562274:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562334:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127092.562412:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937856 00000100:00100000:2.0:1789127092.562422:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937856 00000100:00100000:2.0:1789127092.562494:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938368 00000100:00100000:2.0:1789127092.562498:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938368 00000100:00100000:2.0:1789127092.562537:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937728 00000100:00100000:2.0:1789127092.562540:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937728 00000100:00100000:2.0:1789127092.562553:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938240 00000100:00100000:2.0:1789127092.562555:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938240 00000100:00100000:2.0:1789127092.562570:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:2.0:1789127092.562580:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258937856:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127092.562699:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258937856:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 119us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127092.562707:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:2.0:1789127092.562730:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1789127092.562737:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938368:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127092.562954:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938368:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 216us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127092.562962:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1789127092.562977:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1789127092.562983:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2394:x1876035258937728:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127092.563020:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2394:x1876035258937728:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 36us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127092.563026:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1789127092.563038:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1789127092.563045:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2394:x1876035258938240:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127092.563070:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2394:x1876035258938240:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127092.563076:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1789127092.563261:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937600 00000100:00100000:3.0:1789127092.563267:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937600 00000100:00100000:3.0:1789127092.563311:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:3.0:1789127092.563319:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2394:x1876035258937600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127092.563360:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2394:x1876035258937600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.563367:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:3.0:1789127092.563409:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938112 00000100:00100000:3.0:1789127092.563413:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938112 00000100:00100000:3.0:1789127092.563447:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938624 00000100:00100000:3.0:1789127092.563450:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938624 00000100:00100000:3.0:1789127092.563465:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258937984 00000100:00100000:3.0:1789127092.563467:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258937984 00000100:00100000:3.0:1789127092.563481:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938496 00000100:00100000:3.0:1789127092.563484:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938496 00000100:00100000:3.0:1789127092.563500:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1789127092.563506:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258938112:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127092.563536:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258938112:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.563542:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1789127092.563554:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1789127092.563559:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938624:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127092.563604:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938624:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.563612:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1789127092.563626:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789127092.563632:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258937984:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127092.563688:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258937984:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 56us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.563705:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789127092.563719:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789127092.563725:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938496:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127092.563759:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258938496:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127092.563767:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00080000:3.0:1789127092.563805:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127092.563810:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127092.563813:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127092.563815:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1789127092.651465:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127093.293150:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127094.314844:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127094.447500:0:20914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0c45ae50 20000000:00000080:3.0:1789127094.447515:0:20914:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9942066ce000 uarg=0000000000000000 20000000:01000000:3.0:1789127094.447553:0:20914:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127094.447558:0:20914:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127094.447563:0:20914:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789127094.448321:0:20915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789127094.448461:0:20914:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789127094.452344:0:20914:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789127094.452435:0:20914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452455:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 23 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452464:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 23 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452471:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 23 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452478:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452486:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452494:0:20914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452500:0:20914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452544:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.452560:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 12 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.452575:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843392:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127094.454116:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.454135:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 12 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.454152:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843520:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127094.454211:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.454220:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.454228:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843648:0@lo:104: 00000100:00100000:2.0:1789127094.454263:0:20914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127094.454297:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 23 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.454306:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 23 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.454314:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843648 00000100:00100000:2.0:1789127094.454315:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843776:0@lo:104: 00000100:00100000:1.0:1789127094.454326:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843648 00000100:00100000:2.0:1789127094.454339:0:20914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127094.454368:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843776 00000100:00100000:1.0:1789127094.454372:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843776 00010000:00010000:2.0:1789127094.454375:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 23 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.454385:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 23 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.454393:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127094.454397:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843904:0@lo:104: 00000100:00100000:2.0:1789127094.454428:0:20914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127094.454443:0:20914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 23 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127094.454451:0:20914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 23 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.454459:0:20914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276844032:0@lo:104: 00000100:00100000:2.0:1789127094.454474:0:20914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127094.454480:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:20914:x1876035276843648:12345-0@lo:104: 00000100:00100000:2.0:1789127094.454484:0:20914:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789127094.454496:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454572:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127094.454578:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:20914:x1876035276843648:12345-0@lo:104: Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.454587:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127094.454607:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276843904 00000100:00100000:1.0:1789127094.454610:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276843904 00010000:00010000:3.0:1789127094.454618:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789127094.454623:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844032 00000100:00100000:1.0:1789127094.454627:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844032 00010000:00010000:3.0:1789127094.454628:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.454637:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166000 already unused, calling callback (ffffffffc132ec20) 00000100:00100000:1.0:1789127094.454641:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 10000000:00010000:3.0:1789127094.454644:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.454676:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:20914:x1876035276843776:12345-0@lo:104: 00010000:00010000:1.0:1789127094.454684:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454720:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127094.454725:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+5:20914:x1876035276843776:12345-0@lo:104: Request processed in 77us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.454731:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127094.454744:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127094.454750:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:20914:x1876035276843904:12345-0@lo:104: 00010000:00010000:1.0:1789127094.454757:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454792:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127094.454800:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+4:20914:x1876035276843904:12345-0@lo:104: Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.454809:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789127094.454810:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.454823:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:3.0:1789127094.454826:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127094.454837:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789127094.454842:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:20914:x1876035276844032:12345-0@lo:104: 00010000:00010000:1.0:1789127094.454862:0:17860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454918:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789127094.454923:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+3:20914:x1876035276844032:12345-0@lo:104: Request processed in 85us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.454928:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789127094.454937:0:20291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.454945:0:20291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127094.454946:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127094.454952:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454960:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789127094.454963:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.454971:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.454972:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.454988:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212166000/0xa840b4da666ebe0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebe13 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127094.454990:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127094.455006:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789127094.455011:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127094.455015:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455022:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc132ec20) 00010000:00010000:1.0:1789127094.455023:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127094.455026:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455038:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127094.455043:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455048:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127094.455052:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127094.455060:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127094.455070:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3000/0xa840b4da666ebd72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd79 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455084:0:20291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455084:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127094.455089:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455095:0:20291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127094.455101:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789127094.455105:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455112:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455113:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127094.455124:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455127:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3a00/0xa840b4da666ebd33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd3a expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127094.455136:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789127094.455148:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127094.455152:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127094.455153:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127094.455156:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455163:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789127094.455170:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789127094.455171:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455181:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212167e00/0xa840b4da666ebd25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ebd2c expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127094.455185:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276844544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127094.455198:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127094.455206:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127094.455209:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127094.455217:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127094.455221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127094.455250:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844544 00000100:00100000:1.0:1789127094.455254:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844544 00000100:00100000:3.0:1789127094.455256:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276844416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127094.455279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127094.455279:0:17864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 24 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.455308:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844416 00000100:00100000:1.0:1789127094.455311:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844416 00000100:00100000:3.0:1789127094.455314:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789127094.455324:0:17864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 25 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127094.455325:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3640:x1876035276844544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127094.455340:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127094.455349:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 25 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.455352:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127094.455367:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3640:x1876035276844416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127094.455368:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 25 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455379:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127094.455385:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 25 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.455390:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127094.455416:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3640:x1876035276844544:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127094.455428:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127094.455466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276844544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127094.455517:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 24 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.455530:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127094.455561:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276844416:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.455568:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127094.455679:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843648:0@lo:104: 00000100:00100000:2.0:1789127094.455687:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843776:0@lo:104: 00010000:00010000:2.0:1789127094.455695:0:20914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2a00/0xa840b4da666ebd3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebd33 expref: 23 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.455705:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843904:0@lo:104: 00010000:00010000:2.0:1789127094.455711:0:20914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ebd2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebd25 expref: 22 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127094.455719:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276844032:0@lo:104: 00000100:00100000:3.0:1789127094.456071:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276844416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127094.456428:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276844160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127094.456469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127094.456505:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127094.456511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276844288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127094.456530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127094.456642:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844160 00000100:00100000:1.0:1789127094.456710:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844160 00000100:00100000:3.0:1789127094.456725:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844288 00000100:00100000:3.0:1789127094.456730:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844288 00010000:00010000:1.0:1789127094.456737:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.456883:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127094.456967:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:3641:x1876035276844160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127094.456979:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127094.456984:0:20223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.456993:0:20223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.457006:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67600/0xa840b4da666ebe13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebe0c expref: 23 pid: 17870 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.457018:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127094.457048:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3641:x1876035276844160:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.457054:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789127094.457109:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 21 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127094.457146:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127094.457155:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3641:x1876035276844288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127094.457163:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127094.457167:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 21 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127094.457175:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 21 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127094.457184:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104397200/0xa840b4da666ebd79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ebd72 expref: 21 pid: 17872 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127094.457193:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127094.457214:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:3641:x1876035276844288:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127094.457219:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127094.457245:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276844288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127094.457251:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276844160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127094.458669:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127094.458700:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127094.458719:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938752 00000100:00100000:1.0:1789127094.458727:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938752 00010000:00010000:1.0:1789127094.458757:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 13 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127094.458764:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258938880 00000100:00100000:0.0:1789127094.458770:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258938880 00010000:00010000:0.0:1789127094.458796:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 14 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127094.458797:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1789127094.458823:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1789127094.458831:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+14:2393:x1876035258938880:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127094.458843:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127094.458848:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 14 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127094.458858:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 14 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127094.458875:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127094.458926:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+14:2393:x1876035258938880:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127094.458933:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1789127094.459498:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258938752:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127094.459512:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127094.459519:0:20223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 13 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459545:0:20223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 13 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459561:0:20223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459569:0:20223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459585:0:20223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459592:0:20223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459598:0:20223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459605:0:20223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459611:0:20223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127094.459616:0:20223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459624:0:20223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459633:0:20223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127094.459677:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127094.459713:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258938752:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 905us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127094.459721:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00010000:00010000:3.0:1789127094.460061:0:20914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca200/0xa840b4da666ec066 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c816 expref: 12 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127094.460077:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843392:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789127094.460088:0:20914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb600/0xa840b4da666ec027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7a6 expref: 11 pid: 17871 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127094.460096:0:20914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20914:1876035276843520:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789127094.460126:0:20914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.460136:0:20914:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.460143:0:20914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127094.460150:0:20914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589400/0xa840b4da666ec097 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.341740:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127095.468040:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127095.468065:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104068b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276844672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127095.468137:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127095.468383:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844672 00000100:00100000:0.0:1789127095.468392:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844672 00000100:00100000:0.0:1789127095.468450:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127095.468460:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276844672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127095.468498:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789127095.468562:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276844672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.468579:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127095.468734:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104068b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276844672:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1789127095.531172:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127095.531180:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994207565800 from 19 10000000:01000000:3.0:1789127095.531185:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127095.531234:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.531245:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.531257:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127095.531281:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276844800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.531352:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127095.531396:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127095.531465:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844800 00000100:00100000:0.0:1789127095.531472:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844800 00000100:00100000:0.0:1789127095.531527:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789127095.531537:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:17874:x1876035276844800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127095.531563:0:17872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127095.531576:0:17872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb800/0xa840b4da666ec0a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec09e expref: -99 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.531601:0:17872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb800/0xa840b4da666ec0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec09e expref: 21 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.531612:0:17872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb800/0xa840b4da666ec0a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec09e expref: 21 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.531622:0:17872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb800, rc 0) 00000100:00100000:0.0:1789127095.531703:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276844800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.531709:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789127095.532300:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276844800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127095.532318:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.532328:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127095.532393:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276844928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.532425:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.532456:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127095.532513:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276844928 00000100:00100000:2.0:1789127095.532518:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276844928 00000100:00100000:2.0:1789127095.532552:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789127095.532559:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276844928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127095.532742:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276844928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127095.532749:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789127095.533028:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276844928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.533059:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.533098:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.533127:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127095.533234:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845056 00000100:00100000:3.0:1789127095.533239:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845056 00000100:00100000:3.0:1789127095.533261:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127095.533267:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276845056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.533346:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276845056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.533353:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789127095.533702:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127095.538675:0:20935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789127095.546248:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789127095.546298:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127095.546310:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.546322:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127095.546333:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127095.546336:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9942064a1800 from 19 10000000:01000000:3.0:1789127095.546338:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127095.546379:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.546386:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.546398:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127095.546424:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.546493:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127095.546531:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127095.548257:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845184 00000100:00100000:0.0:1789127095.548269:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845184 00000100:00100000:0.0:1789127095.548321:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789127095.548332:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:17874:x1876035276845184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127095.548347:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127095.548366:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cac00/0xa840b4da666ec0b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec0ac expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.548396:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cac00/0xa840b4da666ec0b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec0ac expref: 22 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.548407:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cac00/0xa840b4da666ec0b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec0ac expref: 22 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.548417:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cac00, rc 0) 00000100:00100000:0.0:1789127095.548502:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.548509:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127095.548602:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127095.548620:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.548640:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127095.548750:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.548792:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.548815:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127095.549029:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845312 00000100:00100000:3.0:1789127095.549033:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845312 00000100:00100000:3.0:1789127095.549067:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789127095.549074:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.549173:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.549180:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789127095.549303:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.549333:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.549372:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.549393:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127095.549531:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845440 00000100:00100000:3.0:1789127095.549540:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845440 00000100:00100000:3.0:1789127095.549567:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789127095.549572:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.549637:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.549643:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789127095.549780:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127095.550575:0:20937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789127095.550630:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789127095.550670:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127095.550680:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.550691:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127095.550702:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127095.550704:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422035d800 from 19 10000000:01000000:1.0:1789127095.550707:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127095.550748:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.552246:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.552262:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127095.552288:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.552349:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.552427:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127095.564515:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845568 00000100:00100000:3.0:1789127095.564531:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845568 00000100:00100000:1.0:1789127095.564748:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789127095.564761:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:17874:x1876035276845568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127095.564788:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127095.564808:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104396800/0xa840b4da666ec0c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec0ba expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.565099:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104396800/0xa840b4da666ec0c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec0ba expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.565112:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104396800/0xa840b4da666ec0c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec0ba expref: 23 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127095.565122:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396800, rc 0) 00000100:00100000:1.0:1789127095.565213:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 454us (12863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127095.565220:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127095.565309:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127095.565330:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.565340:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127095.565415:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.565450:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127095.565486:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127095.565529:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845696 00000100:00100000:1.0:1789127095.565534:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845696 00000100:00100000:3.0:1789127095.565720:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127095.565742:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.565872:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.565892:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789127095.577172:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.577238:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.577315:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127095.577358:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127095.577376:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845824 00000100:00100000:0.0:1789127095.577382:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845824 00000100:00100000:0.0:1789127095.577423:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127095.577432:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.577527:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.577535:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127095.577593:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127095.582810:0:20939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789127095.584276:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789127095.584298:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127095.584309:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.584323:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127095.584333:0:17874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127095.584336:0:17874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9941050e6800 from 19 10000000:01000000:3.0:1789127095.584338:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127095.584379:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.584387:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.584419:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127095.584446:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.584517:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127095.584564:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127095.584937:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276845952 00000100:00100000:0.0:1789127095.584945:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276845952 00000100:00100000:0.0:1789127095.584997:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789127095.585924:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:17874:x1876035276845952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127095.585943:0:17870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127095.585961:0:17870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca400/0xa840b4da666ec0cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec0c8 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.585992:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca400/0xa840b4da666ec0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec0c8 expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.587135:0:17870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca400/0xa840b4da666ec0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec0c8 expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.587150:0:17870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca400, rc 0) 00000100:00100000:0.0:1789127095.587224:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276845952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1312us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.587233:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127095.590472:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276845952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127095.590502:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.590515:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127095.590614:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.590693:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127095.590728:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127095.591162:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846080 00000100:00100000:0.0:1789127095.591170:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846080 00000100:00100000:0.0:1789127095.591217:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789127095.591228:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276846080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.591358:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276846080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.591366:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789127095.591688:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.591734:0:17874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276846208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.591790:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127095.591815:0:17874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127095.591838:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846208 00000100:00100000:3.0:1789127095.591842:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846208 00000100:00100000:3.0:1789127095.591866:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789127095.591872:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276846208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.591958:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:17874:x1876035276846208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.591971:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789127095.592023:0:17874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:17874:1876035276846208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127095.596434:0:20940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789127095.596857:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789127095.596887:0:17874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127095.596911:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127095.596923:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127095.823919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127095.824086:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939008 00000100:00100000:3.0:1789127095.824098:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939008 00000100:00100000:3.0:1789127095.824159:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:3.0:1789127095.824171:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:15164:x1876035258939008:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127095.824189:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127095.824211:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67400/0xa840b4da666ec0d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c84e expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.824241:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67400/0xa840b4da666ec0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c84e expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.824253:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67400/0xa840b4da666ec0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c84e expref: 12 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.824263:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67400, rc 0) 00000100:00100000:3.0:1789127095.824323:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939008:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 154us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.824330:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:2.0:1789127095.832434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127095.834044:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939136 00000100:00100000:1.0:1789127095.834058:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939136 00000100:00100000:1.0:1789127095.834119:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1789127095.834131:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939136:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127095.834308:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939136:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 178us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127095.834317:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1789127095.843582:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127095.843727:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939264 00000100:00100000:2.0:1789127095.843739:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939264 00000100:00100000:2.0:1789127095.843808:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1789127095.843828:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939264:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127095.843985:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994220303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939264:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 167us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127095.843994:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:0.0:1789127095.871136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127095.871756:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939392 00000100:00100000:3.0:1789127095.871777:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939392 00000100:00100000:3.0:1789127095.871857:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1789127095.871869:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:15164:x1876035258939392:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127095.871898:0:17871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127095.871934:0:17871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994104b67200/0xa840b4da666ec0dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c855 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.871968:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994104b67200/0xa840b4da666ec0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c855 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.871980:0:17871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994104b67200/0xa840b4da666ec0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c855 expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127095.871991:0:17871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104b67200, rc 0) 00000100:00100000:3.0:1789127095.872056:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15164:x1876035258939392:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 189us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.872064:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1789127095.875908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127095.876096:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939520 00000100:00100000:0.0:1789127095.876108:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939520 00000100:00100000:0.0:1789127095.876163:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:0.0:1789127095.876174:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15164:x1876035258939520:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127095.876324:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15164:x1876035258939520:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 151us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127095.876332:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:2.0:1789127095.887380:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127095.887625:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939648 00000100:00100000:3.0:1789127095.887637:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939648 00000100:00100000:3.0:1789127095.887722:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:3.0:1789127095.887733:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15164:x1876035258939648:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127095.887898:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:15164:x1876035258939648:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 165us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127095.887908:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1789127095.979132:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276846336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127095.979203:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127095.979257:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846336 00000100:00100000:1.0:1789127095.979264:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846336 00000100:00100000:1.0:1789127095.979308:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127095.979316:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276846336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127095.979347:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127095.979385:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276846336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127095.979392:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127095.979431:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276846336:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127096.368979:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127096.492036:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127096.492062:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276846464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127096.492137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127096.492293:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846464 00000100:00100000:3.0:1789127096.492302:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846464 00000100:00100000:3.0:1789127096.492382:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127096.492395:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276846464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127096.492425:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127096.492472:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276846464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127096.492492:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127096.492540:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276846464:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789127096.493066:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789127096.620452:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127097.386941:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127097.515577:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276846848:0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.515622:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276846976:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.515716:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276846720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515727:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276847360:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.515752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.515763:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276847872:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.515767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276847232:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.515784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.515785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.515809:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276847744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515823:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847872 00000100:00100000:2.0:1789127097.515830:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847872 00000100:00100000:1.0:1789127097.515832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.515857:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846720 00000100:00100000:1.0:1789127097.515860:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846720 00000100:00100000:2.0:1789127097.515889:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847744 00000100:00100000:1.0:1789127097.515889:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847232 00000100:00100000:2.0:1789127097.515892:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847744 00000100:00100000:1.0:1789127097.515892:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847232 00000100:00100000:2.0:1789127097.515907:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127097.515907:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789127097.515915:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276846720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515916:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.515965:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276847872:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.515965:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276846720:12345-0@lo:400:kworker.0 Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127097.515973:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127097.515973:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127097.515989:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127097.515995:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276847744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516000:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127097.516005:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276847232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516022:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276847744:12345-0@lo:400:kworker.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.516026:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276847232:12345-0@lo:400:kworker.0 Request processed in 21us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127097.516029:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127097.516031:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789127097.516044:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127097.516047:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127097.516056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.516062:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276846720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516071:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276847232:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516072:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276847488:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276847744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276848000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516159:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789127097.516165:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276846592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276847104:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516246:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276847616:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516275:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276848128:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127097.516311:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846848 00000100:00100000:2.0:1789127097.516320:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846848 00000100:00100000:0.0:1789127097.516324:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847360 00000100:00100000:0.0:1789127097.516328:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847360 00000100:00100000:1.0:1789127097.516465:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276848000 00000100:00100000:1.0:1789127097.516469:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276848000 00000100:00100000:1.0:1789127097.516487:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847104 00000100:00100000:1.0:1789127097.516495:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847104 00000100:00100000:1.0:1789127097.516509:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847616 00000100:00100000:1.0:1789127097.516511:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847616 00000100:00100000:1.0:1789127097.516519:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276848128 00000100:00100000:1.0:1789127097.516522:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276848128 00000100:00100000:1.0:1789127097.516533:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127097.516538:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276848000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516574:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276848000:12345-0@lo:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.516580:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127097.516592:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127097.516598:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276847104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516624:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276847104:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.516629:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127097.516639:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127097.516644:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516685:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276847616:12345-0@lo:400:kworker.0 Request processed in 41us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.516690:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127097.516701:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127097.516706:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276848128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516729:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276848128:12345-0@lo:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.516735:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127097.516775:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276848256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127097.516807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127097.516843:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276847104:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516853:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276847616:0@lo:400:kworker.0 00010000:00080000:1.0:1789127097.516877:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99423664c3c0 x1876035276848128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127097.516887:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276848128:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.516897:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276848000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.516962:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846976 00000100:00100000:2.0:1789127097.516966:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846976 00000100:00100000:0.0:1789127097.517328:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276847488 00000100:00100000:0.0:1789127097.517333:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276847488 00000100:00100000:0.0:1789127097.517353:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127097.517360:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276846848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.517395:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276846848:12345-0@lo:400:kworker.0 Request processed in 36us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.517401:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127097.517412:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127097.517418:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276847360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.517441:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276847360:12345-0@lo:400:kworker.0 Request processed in 24us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.517453:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127097.517465:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127097.517471:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276846976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.517500:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276846976:12345-0@lo:400:kworker.0 Request processed in 29us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.517505:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127097.517515:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127097.517521:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276847488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.517545:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276847488:12345-0@lo:400:kworker.0 Request processed in 25us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.517551:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127097.518186:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276846592 00000100:00100000:0.0:1789127097.518201:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276846592 00000100:00100000:0.0:1789127097.518231:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789127097.518237:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276846592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.518270:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276846592:12345-0@lo:400:kworker.0 Request processed in 34us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.518276:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789127097.518334:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276848256 00000100:00100000:0.0:1789127097.518338:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276848256 00000100:00100000:0.0:1789127097.518358:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127097.518364:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276848256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127097.518383:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789127097.518411:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276848256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.518426:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789127097.518440:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127097.518444:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127097.518446:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127097.518448:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127097.518461:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104069680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276848384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127097.518488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127097.518517:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276846848:0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.518528:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276847360:0@lo:400:kworker.0 00010000:00080000:0.0:1789127097.518540:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941041ee580 x1876035276847872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127097.518549:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276847872:0@lo:400:kworker.0 00000100:00100000:0.0:1789127097.519159:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276848384 00000100:00100000:0.0:1789127097.519165:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276848384 00000100:00100000:0.0:1789127097.519204:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127097.519212:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276848384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127097.519226:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789127097.519265:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276848384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.519271:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127097.519290:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127097.519298:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276848512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127097.519325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127097.519347:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276848512 00000100:00100000:0.0:1789127097.519350:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276848512 00000100:00100000:0.0:1789127097.519374:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127097.519380:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276848512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127097.519391:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789127097.519425:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276848512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.519431:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127097.519462:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276848512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127097.519489:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104069680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276848384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127097.523252:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276848256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127097.523301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276846592:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.523315:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276846976:0@lo:400:kworker.0 00000100:00100000:1.0:1789127097.523325:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276847488:0@lo:400:kworker.0 00000100:00100000:2.0:1789127097.692177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127097.692232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127097.692267:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127097.692549:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940288 00000100:00100000:3.0:1789127097.692561:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940288 00000100:00100000:3.0:1789127097.692626:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1789127097.692639:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127097.692769:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 131us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127097.692777:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1789127097.693687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127097.693794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127097.693815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127097.693933:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940032 00000100:00100000:1.0:1789127097.693940:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940032 00000100:00100000:1.0:1789127097.693975:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940544 00000100:00100000:1.0:1789127097.693978:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940544 00000100:00100000:1.0:1789127097.694007:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939904 00000100:00100000:1.0:1789127097.694010:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939904 00000100:00100000:1.0:1789127097.694027:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1789127097.694035:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127097.694109:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258939776 00000100:00100000:0.0:1789127097.694113:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258939776 00000100:00100000:0.0:1789127097.694140:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:0.0:1789127097.694146:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258939776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127097.694180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127097.694751:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1789127097.694764:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127097.698714:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 4668us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.698730:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1789127097.698768:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:1.0:1789127097.698794:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258939904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127097.699226:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2393:x1876035258939904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 435us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.699234:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1789127097.701502:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258939776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 7345us (9326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.701516:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:0.0:1789127097.701578:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940800 00000100:00100000:0.0:1789127097.701587:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940800 00000100:00100000:0.0:1789127097.701633:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940160 00000100:00100000:0.0:1789127097.701635:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940160 00000100:00100000:0.0:1789127097.701671:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1789127097.701680:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127097.701720:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.701726:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1789127097.701736:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789127097.701754:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127097.701775:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258940160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.701781:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00080000:0.0:1789127097.701800:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127097.701805:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127097.701807:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127097.701809:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127097.702856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127097.702947:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127097.703028:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940672 00000100:00100000:0.0:1789127097.703034:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940672 00000100:00100000:0.0:1789127097.703094:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789127097.703103:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127097.703155:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127097.703162:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00080000:2.0:1789127097.703251:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127097.703286:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940416 00000100:00100000:1.0:1789127097.703290:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940416 00000100:00100000:1.0:1789127097.703367:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1789127097.703378:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258940416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127097.703413:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258940416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 36us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127097.703419:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:3.0:1789127097.703610:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258940544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 8848us (11310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127097.703621:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00080000:2.0:1789127097.703763:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127098.411402:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127098.439155:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.439272:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258940928 00000100:00100000:0.0:1789127098.439282:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258940928 00000100:00100000:0.0:1789127098.439346:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789127098.439357:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+6:15838:x1876035258940928:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127098.439379:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127098.439399:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec0e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c85c expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439462:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439478:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439503:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439517:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439524:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439531:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439602:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439609:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439617:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127098.439642:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127098.439646:0:19940:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127098.439713:0:19940:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439724:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439730:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439749:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439755:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.439759:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439767:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439780:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:0.0:1789127098.439783:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.439788:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439794:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec0eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439807:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439813:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439819:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439824:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cae00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.439826:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439840:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439848:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994102e06900) 00010000:00010000:0.0:1789127098.439850:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.439852:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439869:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec0f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439901:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec0e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c85c expref: 8 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439914:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c85c expref: 7 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.439922:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994102e06300) 00010000:00010000:0.0:1789127098.439924:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127098.439927:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb000, rc 0) 00000100:00100000:0.0:1789127098.440073:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15838:x1876035258940928:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 717us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127098.440080:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1789127098.453299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127098.461671:0:17888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941056 00000100:00100000:2.0:1789127098.461688:0:17888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941056 00000100:00100000:2.0:1789127098.461772:0:17888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1789127098.462249:0:17888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15838:x1876035258941056:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789127098.462680:0:17888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15838:x1876035258941056:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 897us (9388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127098.462690:0:17888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789127098.465754:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.465842:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941312 00000100:00100000:3.0:1789127098.465853:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941312 00000100:00100000:3.0:1789127098.466068:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1789127098.466079:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15838:x1876035258941312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127098.466277:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127098.466305:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666ec100 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c863 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466378:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466405:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466418:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466454:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466463:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466470:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466689:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3e00/0xa840b4da666ec115 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466698:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3e00/0xa840b4da666ec115 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466706:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3e00/0xa840b4da666ec115 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127098.466715:0:20680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789127098.466844:0:20680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466852:0:20680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466869:0:20680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466881:0:20680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127098.466886:0:20680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466894:0:20680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.466906:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994102e06300) 00010000:00010000:3.0:1789127098.466909:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127098.467198:0:20680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467206:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b67600/0xa840b4da666ec107 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467219:0:20680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467225:0:20680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467231:0:20680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467237:0:20680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127098.467239:0:20680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467245:0:20680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467263:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99410261f500) 00010000:00010000:3.0:1789127098.467266:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127098.467269:0:20680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.467276:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec10e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.471775:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104b66600/0xa840b4da666ec100 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c863 expref: 10 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.471803:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3e00/0xa840b4da666ec115 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c863 expref: 9 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.471813:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99410261f400) 00010000:00010000:3.0:1789127098.471816:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127098.471820:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:3.0:1789127098.472196:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15838:x1876035258941312:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 6117us (6450us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127098.472206:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789127098.481398:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127098.481547:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941440 00000100:00100000:2.0:1789127098.481559:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941440 00000100:00100000:2.0:1789127098.481619:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1789127098.481629:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15838:x1876035258941440:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789127098.481753:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15838:x1876035258941440:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127098.481775:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1789127098.495182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.497915:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941568 00000100:00100000:0.0:1789127098.497934:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941568 00000100:00100000:0.0:1789127098.498082:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1789127098.498095:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15838:x1876035258941568:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789127098.508683:0:19940:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10531us 00000100:00100000:3.0:1789127098.519338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.519392:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941696 00000100:00100000:0.0:1789127098.519405:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941696 00000100:00100000:0.0:1789127098.519545:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789127098.519559:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15844:x1876035258941696:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789127098.519581:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127098.519604:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c86a expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520273:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520291:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520304:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520318:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520324:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520330:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520364:0:20680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520371:0:20680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520390:0:20680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520395:0:20680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.520399:0:20680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520407:0:20680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520420:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:0.0:1789127098.520424:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.520429:0:20680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.520435:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec12a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521077:0:20680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521084:0:20680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521090:0:20680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521095:0:20680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.521098:0:20680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521115:0:20680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521125:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994102e06900) 00010000:00010000:0.0:1789127098.521127:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.521130:0:20680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521136:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.521174:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec123 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c86a expref: 10 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.522082:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:0.0:1789127098.522088:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.522095:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c86a expref: 10 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.522108:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cae00, rc 0) 00000100:00100000:0.0:1789127098.522599:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15844:x1876035258941696:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 3041us (3268us total) trans 0 rc 301/301 00000100:00100000:0.0:1789127098.522610:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789127098.524431:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15838:x1876035258941568:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 26329us (29249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127098.524456:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:3.0:1789127098.528431:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.528567:0:17885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258941824 00000100:00100000:0.0:1789127098.528587:0:17885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258941824 00000100:00100000:0.0:1789127098.528668:0:17885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789127098.528679:0:17885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15844:x1876035258941824:12345-192.168.203.23@tcp:700:lfs.0 00000100:00100000:0.0:1789127098.528764:0:17885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15844:x1876035258941824:12345-192.168.203.23@tcp:700:lfs.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127098.528773:0:17885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1789127098.533162:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127098.534978:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942080 00000100:00100000:2.0:1789127098.535064:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942080 00000100:00100000:2.0:1789127098.535192:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1789127098.535205:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+9:15844:x1876035258942080:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:2.0:1789127098.535264:0:17875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127098.535295:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7d7 expref: 9 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.535317:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:2.0:1789127098.535323:0:17875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127098.535404:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.535420:0:17875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 5 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.535430:0:17875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.535478:0:17875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 5 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.535492:0:17875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 5 pid: 19940 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127098.535507:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276848640:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789127098.535630:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942202b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127098.544514:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.544733:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942208 00000100:00100000:1.0:1789127098.544744:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942208 00010000:00010000:1.0:1789127098.544800:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 6 pid: 19940 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127098.544856:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789127098.544877:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258942208:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127098.544894:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127098.544902:0:17863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 6 pid: 19940 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.544916:0:17863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 6 pid: 19940 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.544956:0:17863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:1.0:1789127098.544963:0:17863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.544973:0:17863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.544994:0:17863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.545016:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127098.545076:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258942208:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 200us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127098.545084:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:2.0:1789127098.548502:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c847 expref: 5 pid: 19940 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127098.548527:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276848640:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127098.548550:0:17875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.548561:0:17875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.548568:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.548597:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.548611:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.549095:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.566592:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.566615:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.566627:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127098.566685:0:17875:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fba74951 reply state 0000000000286422 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567504:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567517:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:2.0:1789127098.567520:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127098.567526:0:17875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789127098.567533:0:17875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789127098.567544:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567552:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567559:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567565:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127098.567570:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567578:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567589:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994203d73a00) 00010000:00010000:2.0:1789127098.567592:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127098.567596:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567628:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec138 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127098.567676:0:17875:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fba74951 reply state 0000000000286422 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567687:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.567694:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994103eaba00) 00010000:00010000:2.0:1789127098.568121:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127098.568124:0:17875:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789127098.568489:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+10:15844:x1876035258942080:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 33282us (35331us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789127098.568499:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000040:00080000:1.0:1789127098.668102:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127098.678468:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.678554:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942336 00000100:00100000:3.0:1789127098.678566:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942336 00000100:00100000:3.0:1789127098.678631:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789127098.678642:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+10:15852:x1876035258942336:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:3.0:1789127098.678717:0:17877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127098.678744:0:17877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c871 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678809:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678825:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678838:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127098.678887:0:17877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127098.678891:0:17877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127098.678928:0:17877:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678954:0:17877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c871 expref: 12 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678972:0:17877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c871 expref: 11 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.678992:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:3.0:1789127098.679159:0:17877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127098.679164:0:17877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2a00, rc 0) 00000100:00100000:3.0:1789127098.679223:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+11:15852:x1876035258942336:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 582us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127098.679230:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1789127098.709774:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.709876:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942464 00000100:00100000:1.0:1789127098.709887:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942464 00000100:00100000:1.0:1789127098.709952:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1789127098.709962:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+5:15853:x1876035258942464:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789127098.709992:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127098.710025:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec15b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c878 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710105:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710121:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710151:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127098.710192:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127098.710195:0:19940:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127098.710215:0:19940:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710239:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c878 expref: 7 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710258:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c878 expref: 6 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.710266:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:1.0:1789127098.710269:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127098.710274:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396400, rc 0) 00000100:00100000:1.0:1789127098.710335:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15853:x1876035258942464:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 374us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127098.710347:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1789127098.718362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127098.718484:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942592 00000100:00100000:2.0:1789127098.718497:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942592 00000100:00100000:2.0:1789127098.718596:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1789127098.718606:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+6:15853:x1876035258942592:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789127098.718627:0:17875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127098.718673:0:17875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c87f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718748:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718764:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718793:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718806:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718813:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718819:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718905:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718913:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.718920:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127098.718958:0:17875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127098.718963:0:17875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127098.718991:0:17875:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719003:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719010:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719027:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719033:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127098.719038:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719046:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719059:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:2.0:1789127098.719063:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127098.719067:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719074:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588000/0xa840b4da666ec170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719087:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719094:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719100:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719105:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127098.719108:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719123:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719131:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994103eaba00) 00010000:00010000:2.0:1789127098.719133:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127098.719136:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719143:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589200/0xa840b4da666ec177 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719168:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589c00/0xa840b4da666ec169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c87f expref: 8 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719181:0:17875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c87f expref: 7 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127098.719189:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:2.0:1789127098.719192:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127098.719194:0:17875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588c00, rc 0) 00000100:00100000:2.0:1789127098.719269:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+7:15853:x1876035258942592:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 665us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127098.719278:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1789127098.725804:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.730891:0:17887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942720 00000100:00100000:3.0:1789127098.730907:0:17887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942720 00000100:00100000:3.0:1789127098.731030:0:17887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1789127098.731042:0:17887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85b3b52e-7532-42e2-9665-c726ed80b63f+5:15853:x1876035258942720:12345-192.168.203.23@tcp:900:lfs.0 00000100:00100000:3.0:1789127098.731147:0:17887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85b3b52e-7532-42e2-9665-c726ed80b63f+5:15853:x1876035258942720:12345-192.168.203.23@tcp:900:lfs.0 Request processed in 107us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127098.731156:0:17887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789127098.739141:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.739232:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258942976 00000100:00100000:3.0:1789127098.739244:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258942976 00000100:00100000:3.0:1789127098.739309:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1789127098.739320:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+7:15853:x1876035258942976:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789127098.739345:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127098.739367:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c886 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127098.739464:0:20680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789127098.739562:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec185 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c886 expref: 9 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.739577:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:3.0:1789127098.739581:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127098.739587:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c886 expref: 9 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.739601:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3000, rc 0) 00000100:00100000:3.0:1789127098.741809:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+8:15853:x1876035258942976:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 385us (571us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789127098.741846:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:1.0:1789127098.743047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.743158:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258943232 00000100:00100000:3.0:1789127098.743169:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258943232 00000100:00100000:3.0:1789127098.743232:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1789127098.743244:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+8:15853:x1876035258943232:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1789127098.743301:0:17876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127098.743332:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec17e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c87f expref: 8 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.743349:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:3.0:1789127098.743354:0:17876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127098.743377:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.743391:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.743401:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127098.743590:0:17876:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d9cd8fed reply state 0000000070248124 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.743604:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.743610:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:3.0:1789127098.743613:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789127098.743626:0:17876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789127098.743633:0:17876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789127098.748200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.748373:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258943488 00000100:00100000:3.0:1789127098.748384:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258943488 00000100:00100000:3.0:1789127098.748451:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1789127098.748461:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+10:15853:x1876035258943488:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789127098.748689:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+11:15853:x1876035258943488:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 230us (498us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789127098.748697:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1789127098.751178:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+9:15853:x1876035258943232:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 2959us (3160us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789127098.751204:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1789127098.755044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.755190:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258943744 00000100:00100000:0.0:1789127098.755202:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258943744 00000100:00100000:0.0:1789127098.755272:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1789127098.755283:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+10:15853:x1876035258943744:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789127098.755310:0:17875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127098.755333:0:17875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666ec19a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c88d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755406:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755423:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755454:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755467:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755475:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755482:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127098.755584:0:17875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127098.755683:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755693:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755700:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755716:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.755720:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755729:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755742:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:0.0:1789127098.755745:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.755756:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755763:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755778:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755784:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755790:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755796:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.755799:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755806:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755813:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994103eaba00) 00010000:00010000:0.0:1789127098.755816:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.755819:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755825:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755870:0:17875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666ec19a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c88d expref: 12 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755890:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:0.0:1789127098.755892:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127098.755896:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666ec19a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c88d expref: 12 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.755906:0:17875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca000, rc 0) 00000100:00100000:0.0:1789127098.755964:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+11:15853:x1876035258943744:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 683us (932us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789127098.755972:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1789127098.771086:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.771159:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258943872 00000100:00100000:3.0:1789127098.771171:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258943872 00000100:00100000:3.0:1789127098.771238:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1789127098.771250:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+11:15853:x1876035258943872:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789127098.771273:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127098.771299:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec1b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c894 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771398:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771413:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771427:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127098.771464:0:20680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127098.771468:0:20680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127098.771484:0:20680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771528:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec1b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 13 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771730:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 12 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.771740:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:3.0:1789127098.771744:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127098.771748:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3800, rc 0) 00000100:00100000:3.0:1789127098.771811:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+12:15853:x1876035258943872:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 563us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127098.771819:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:2.0:1789127098.790742:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.792588:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944000 00000100:00100000:1.0:1789127098.792605:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944000 00000100:00100000:1.0:1789127098.792709:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1789127098.792721:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+12:15853:x1876035258944000:12345-192.168.203.23@tcp:37:lfs.0 00000040:00080000:3.0:1789127098.795541:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789127098.804272:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+12:15853:x1876035258944000:12345-192.168.203.23@tcp:37:lfs.0 Request processed in 11541us (13527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127098.804287:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1789127098.819243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.819546:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944256 00000100:00100000:3.0:1789127098.819558:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944256 00000100:00100000:3.0:1789127098.819622:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789127098.819634:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102eb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+12:15853:x1876035258944256:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789127098.820193:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102eb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+13:15853:x1876035258944256:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 560us (959us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789127098.820203:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1789127098.916170:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.916256:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944384 00000100:00100000:0.0:1789127098.916268:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944384 00000100:00100000:0.0:1789127098.916331:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1789127098.916342:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+11:15859:x1876035258944384:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1789127098.916363:0:17876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127098.916384:0:17876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666ec1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c89b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916555:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916572:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916586:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916597:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916620:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.916627:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917319:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917331:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917339:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127098.917606:0:17876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127098.917611:0:17876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127098.917675:0:17876:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917689:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917696:0:17876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917703:0:17876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917770:0:17876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127098.917776:0:17876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.917784:0:17876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.918936:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:1.0:1789127098.918939:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127098.918946:0:17876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.918953:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec1cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.918972:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919331:0:17876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919340:0:17876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919345:0:17876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127098.919348:0:17876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919356:0:17876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919365:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994103eaba00) 00010000:00010000:1.0:1789127098.919367:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127098.919371:0:17876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919377:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec1d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919500:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca000/0xa840b4da666ec1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c89b expref: 13 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919519:0:17876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c89b expref: 12 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.919527:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:1.0:1789127098.919529:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789127098.919531:0:17876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397c00, rc 0) 00000100:00100000:1.0:1789127098.919687:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+12:15859:x1876035258944384:12345-192.168.203.23@tcp:101:bash.0 Request processed in 3344us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127098.919697:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1789127098.923364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.923520:0:17888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944512 00000100:00100000:1.0:1789127098.923531:0:17888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944512 00000100:00100000:1.0:1789127098.923587:0:17888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1789127098.923597:0:17888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15859:x1876035258944512:12345-192.168.203.23@tcp:900:bash.0 00000100:00100000:1.0:1789127098.923923:0:17888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15859:x1876035258944512:12345-192.168.203.23@tcp:900:bash.0 Request processed in 326us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127098.923932:0:17888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127098.928201:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.928424:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944768 00000100:00100000:1.0:1789127098.928508:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944768 00000100:00100000:1.0:1789127098.928870:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1789127098.928882:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+12:15859:x1876035258944768:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1789127098.928905:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127098.928929:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec1e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8a2 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.929365:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.929382:0:19940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 12 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.929392:0:19940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.929425:0:19940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 12 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127098.929449:0:19940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 12 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127098.929462:0:19940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19940:1876035276848768:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789127098.929548:0:19940:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423470bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127098.932353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127098.932493:0:19940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941041ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19940:1876035276848768:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127098.932517:0:19940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127098.932620:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258944896 00000100:00100000:3.0:1789127098.932627:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258944896 00010000:00010000:3.0:1789127098.932693:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 13 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127098.932731:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789127098.932751:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+13:2394:x1876035258944896:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127098.932765:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127098.932772:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 13 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932783:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 13 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932813:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec1bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c894 expref: 13 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932828:0:17862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:3.0:1789127098.932833:0:17862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932843:0:17862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932851:0:17862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.932878:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127098.932927:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85b3b52e-7532-42e2-9665-c726ed80b63f+12:2394:x1876035258944896:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 177us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127098.932935:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00010000:00010000:0.0:1789127098.935102:0:19940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935116:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935147:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935162:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935174:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935625:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935635:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935691:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127098.935714:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789127098.935743:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935751:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935759:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935765:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127098.935769:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935777:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935788:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:0.0:1789127098.935791:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127098.935796:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.935803:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec1e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127098.935991:0:19940:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000664cc63d reply state 0000000035daecb8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.936013:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.936020:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff994102e06900) 00010000:00010000:0.0:1789127098.936022:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127098.936025:0:19940:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789127098.936060:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec1e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 15 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.936077:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 14 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127098.936084:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127098.936086:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789127098.936088:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cba00, rc 0) 00000100:00100000:0.0:1789127098.936157:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+15:15859:x1876035258944768:12345-192.168.203.23@tcp:101:bash.0 Request processed in 7276us (7965us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789127098.936166:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1789127098.956924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127098.957027:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258945024 00000100:00100000:3.0:1789127098.957038:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258945024 00000100:00100000:3.0:1789127098.957102:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1789127098.957114:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+15:15859:x1876035258945024:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789127098.957156:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127098.957180:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec203 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8a9 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957248:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957264:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957277:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127098.957327:0:20680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127098.957331:0:20680:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127098.957351:0:20680:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957363:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957387:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec203 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 17 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957404:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 16 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127098.957413:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:3.0:1789127098.957416:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127098.957420:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2400, rc 0) 00000100:00100000:3.0:1789127098.957621:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+16:15859:x1876035258945024:12345-192.168.203.23@tcp:101:bash.0 Request processed in 508us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127098.957630:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1789127098.960882:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127098.960959:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258945280 00000100:00100000:1.0:1789127098.960969:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258945280 00000100:00100000:1.0:1789127098.961034:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789127098.961043:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+16:15859:x1876035258945280:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1789127098.961408:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+17:15859:x1876035258945280:12345-192.168.203.23@tcp:35:bash.0 Request processed in 365us (534us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789127098.961416:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1789127099.097235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.097803:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258945536 00000100:00100000:1.0:1789127099.097815:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258945536 00000100:00100000:1.0:1789127099.097910:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1789127099.097922:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+17:15869:x1876035258945536:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789127099.097944:0:17876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127099.097966:0:17876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8b0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127099.098076:0:17876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789127099.098170:0:17876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec211 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8b0 expref: 19 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.098185:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:1.0:1789127099.098187:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127099.098193:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8b0 expref: 19 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.098209:0:17876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104397200, rc 0) 00000100:00100000:1.0:1789127099.098274:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+18:15869:x1876035258945536:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 355us (1049us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789127099.098282:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00080000:2.0:1789127099.098620:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127099.100951:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.101202:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258945792 00000100:00100000:0.0:1789127099.101213:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258945792 00000100:00100000:0.0:1789127099.101271:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789127099.101281:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+18:15869:x1876035258945792:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789127099.102723:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15869:x1876035258945792:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 1436us (1774us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789127099.102733:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789127099.151449:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.151569:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946048 00000100:00100000:1.0:1789127099.151580:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946048 00000100:00100000:1.0:1789127099.151679:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:1.0:1789127099.151690:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15872:x1876035258946048:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789127099.151724:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127099.151748:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec21f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8b7 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.151880:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec226 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.151896:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.151908:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127099.151919:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789127099.152019:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec21f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8b7 expref: 22 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.152038:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec226 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8b7 expref: 21 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.152047:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127099.152050:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127099.152054:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994104396600, rc 0) 00000100:00100000:1.0:1789127099.152119:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15872:x1876035258946048:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 431us (681us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789127099.152127:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789127099.156138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.156181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.156367:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946176 00000100:00100000:2.0:1789127099.156378:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946176 00000100:00100000:2.0:1789127099.156446:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789127099.156456:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15872:x1876035258946176:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1789127099.156527:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156545:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156557:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156594:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156601:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156608:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156614:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.156619:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156627:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156690:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127099.156694:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127099.156700:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.156706:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec234 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127099.156776:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15872:x1876035258946176:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 321us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.156784:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1789127099.156932:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946304 00000100:00100000:1.0:1789127099.156937:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946304 00000100:00100000:1.0:1789127099.156971:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127099.156978:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+21:2393:x1876035258946304:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127099.156990:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127099.157021:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec226 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8b7 expref: 21 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.157033:0:17863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127099.157036:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127099.157057:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+20:2393:x1876035258946304:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 81us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127099.157063:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1789127099.163174:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.163316:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946560 00000100:00100000:1.0:1789127099.163327:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946560 00000100:00100000:1.0:1789127099.163379:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1789127099.163390:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+20:15872:x1876035258946560:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1789127099.163612:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15872:x1876035258946560:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 222us (447us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789127099.163621:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00010000:00010000:1.0:1789127099.435298:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127099.501265:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.501405:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946816 00000100:00100000:2.0:1789127099.501416:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946816 00000100:00100000:2.0:1789127099.501481:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:2.0:1789127099.501491:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15903:x1876035258946816:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1789127099.501517:0:17877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127099.501540:0:17877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec23b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8be expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.501705:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec242 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.501722:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec242 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.501737:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec242 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127099.501764:0:17877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789127099.502231:0:17877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588e00/0xa840b4da666ec23b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8be expref: 24 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.502251:0:17877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec242 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8be expref: 23 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.502261:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127099.502264:0:17877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127099.502268:0:17877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589a00, rc 0) 00000100:00100000:2.0:1789127099.502343:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+23:15903:x1876035258946816:12345-192.168.203.23@tcp:101:cat.0 Request processed in 852us (1088us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789127099.502351:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1789127099.505214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.505308:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258946944 00000100:00100000:2.0:1789127099.505317:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258946944 00000100:00100000:2.0:1789127099.505385:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1789127099.505396:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+23:2394:x1876035258946944:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127099.505429:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127099.505454:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec242 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8be expref: 23 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.505471:0:17862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127099.505477:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127099.505547:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+22:2394:x1876035258946944:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 146us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.505556:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1789127099.506147:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.506330:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258947200 00000100:00100000:2.0:1789127099.506334:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258947200 00000100:00100000:2.0:1789127099.506373:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789127099.506380:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+22:15903:x1876035258947200:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1789127099.506835:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+23:15903:x1876035258947200:12345-192.168.203.23@tcp:35:cat.0 Request processed in 454us (688us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789127099.506843:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1789127099.604306:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.606813:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258947456 00000100:00100000:0.0:1789127099.606829:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258947456 00000100:00100000:0.0:1789127099.606947:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1789127099.606959:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+23:15909:x1876035258947456:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:0.0:1789127099.606995:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127099.607020:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec250 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8c5 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607271:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607288:0:20680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607298:0:20680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 24 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607306:0:20680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607344:0:20680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 24 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607360:0:20680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 24 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127099.607373:0:20680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104068f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20680:1876035276848896:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127099.607718:0:20680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.607737:0:20680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127099.607748:0:20680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406a580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20680:1876035276849024:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127099.607783:0:20680:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213ca76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127099.615425:0:20680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104068f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20680:1876035276848896:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127099.615440:0:20680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406a580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20680:1876035276849024:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127099.615471:0:20680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127099.616428:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.616467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.621889:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258947584 00000100:00100000:1.0:1789127099.621908:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258947584 00010000:00010000:1.0:1789127099.622151:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 25 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127099.622253:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258947712 00000100:00100000:1.0:1789127099.622258:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258947712 00010000:00010000:1.0:1789127099.622273:0:17863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 26 pid: 19940 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127099.625873:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1789127099.625901:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+26:2394:x1876035258947584:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127099.625922:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127099.625949:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 26 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.625968:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 26 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626003:0:17864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec20a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a9 expref: 26 pid: 20680 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626022:0:17864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.626027:0:17864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626053:0:17864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626072:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127099.626143:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+25:2394:x1876035258947584:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 256us (9719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.626152:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1789127099.626179:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1789127099.626187:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+24:2394:x1876035258947712:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127099.626195:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127099.626201:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626211:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626224:0:17864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec1f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8a2 expref: 24 pid: 19940 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626235:0:17864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.626239:0:17864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626247:0:17864:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626254:0:17864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626289:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127099.626309:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+23:2394:x1876035258947712:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 122us (9841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.626315:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00010000:00010000:0.0:1789127099.626367:0:20680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626375:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127099.626393:0:20680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789127099.626952:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec250 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8c5 expref: 24 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626969:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8c5 expref: 23 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.626985:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.626987:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127099.626990:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca800, rc 0) 00000100:00100000:0.0:1789127099.627018:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+23:15909:x1876035258947456:12345-192.168.203.23@tcp:101:dd.0 Request processed in 20061us (22722us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789127099.627025:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1789127099.636290:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.636378:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258947840 00000100:00100000:0.0:1789127099.636388:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258947840 00000100:00100000:0.0:1789127099.636535:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1789127099.636556:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+23:15909:x1876035258947840:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:0.0:1789127099.636602:0:17876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127099.636627:0:17876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec265 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8cc expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636686:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636702:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636714:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636819:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec265 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 25 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636838:0:17876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 24 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.636847:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.636862:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127099.636866:0:17876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb200, rc 0) 00000100:00100000:0.0:1789127099.637138:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+24:15909:x1876035258947840:12345-192.168.203.23@tcp:101:dd.0 Request processed in 583us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.637147:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1789127099.640556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.640773:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948096 00000100:00100000:0.0:1789127099.640783:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948096 00000100:00100000:0.0:1789127099.640838:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1789127099.640847:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+24:15909:x1876035258948096:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:0.0:1789127099.641103:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.641121:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.641133:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127099.641179:0:17877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789127099.641200:0:17877:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000206de67 reply state 00000000b7e7860a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.641212:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.641219:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.641223:0:17877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127099.641226:0:17877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127099.641309:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948096:12345-192.168.203.23@tcp:36:dd.0 Request processed in 462us (765us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789127099.641317:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000020:00080000:0.0:1789127099.641329:0:17877:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789127099.648281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.648436:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948224 00000100:00100000:2.0:1789127099.648447:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948224 00000100:00100000:2.0:1789127099.648520:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1789127099.648531:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948224:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1789127099.648555:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127099.648585:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec27a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8d3 expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.648645:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec27a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8d3 expref: 28 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.648687:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec27a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8d3 expref: 28 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.648705:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127099.648708:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127099.648712:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589a00, rc 0) 00000100:00100000:2.0:1789127099.648813:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15909:x1876035258948224:12345-192.168.203.23@tcp:101:dd.0 Request processed in 284us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.648821:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:1.0:1789127099.694006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.695118:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948480 00000100:00100000:0.0:1789127099.695131:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948480 00000100:00100000:0.0:1789127099.695214:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1789127099.695226:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15909:x1876035258948480:12345-192.168.203.23@tcp:103:dd.0 00010000:00010000:0.0:1789127099.695242:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127099.695267:0:17864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589a00/0xa840b4da666ec27a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8d3 expref: 28 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.695298:0:17864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127099.695304:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127099.695363:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948480:12345-192.168.203.23@tcp:103:dd.0 Request processed in 140us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.695375:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1789127099.699004:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.699259:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948608 00000100:00100000:1.0:1789127099.699281:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948608 00000100:00100000:1.0:1789127099.699341:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1789127099.699350:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948608:12345-192.168.203.23@tcp:58:dd.0 00010000:00010000:1.0:1789127099.699447:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.699467:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.699490:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127099.701803:0:19940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127099.702282:0:19940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789127099.702441:0:19940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789127099.706962:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948608:12345-192.168.203.23@tcp:58:dd.0 Request processed in 7600us (7955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127099.706986:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1789127099.718467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.718690:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948736 00000100:00100000:3.0:1789127099.718711:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948736 00000100:00100000:3.0:1789127099.718779:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1789127099.718791:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+27:15909:x1876035258948736:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1789127099.718813:0:17875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127099.718837:0:17875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8da expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.718902:0:17875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.718914:0:17875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 28 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.718952:0:17875:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.718968:0:17875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 28 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.718993:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:3.0:1789127099.718996:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127099.719001:0:17875:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 28 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.719009:0:17875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3000, rc 0) 00000100:00100000:3.0:1789127099.720960:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15909:x1876035258948736:12345-192.168.203.23@tcp:101:dd.0 Request processed in 2159us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127099.720972:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000040:00080000:3.0:1789127099.819454:0:17910:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789127099.819463:0:17910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127099.819489:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789127099.819496:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789127099.819633:0:17910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17910:1876035276849152:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127099.820195:0:17910:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b10780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127099.827863:0:17910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103ec21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17910:1876035276849152:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127099.834687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.834886:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948864 00000100:00100000:0.0:1789127099.834897:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948864 00000100:00100000:0.0:1789127099.834980:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1789127099.834992:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15910:x1876035258948864:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127099.835028:0:17876:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127099.835156:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15910:x1876035258948864:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 167us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.835165:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1789127099.839026:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.844029:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258948992 00000100:00100000:1.0:1789127099.844045:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258948992 00000100:00100000:1.0:1789127099.844128:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:1.0:1789127099.844140:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15910:x1876035258948992:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789127099.844235:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844253:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844269:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844339:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844348:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844355:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844378:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844387:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844394:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127099.844443:0:19940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789127099.844448:0:19940:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127099.844462:0:19940:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844474:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844480:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844487:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844503:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127099.844507:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844516:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844529:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99410261f400) 00010000:00010000:1.0:1789127099.844532:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127099.844537:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844543:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397800/0xa840b4da666ec28f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844559:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844564:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844570:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844574:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127099.844577:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844583:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844602:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9942345fd500) 00010000:00010000:1.0:1789127099.844604:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127099.844607:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844612:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397200/0xa840b4da666ec296 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844626:0:19940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844632:0:19940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844637:0:19940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844642:0:19940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127099.844644:0:19940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.844991:0:19940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.845002:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127099.845004:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127099.845007:0:19940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.845013:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396600/0xa840b4da666ec29d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127099.845117:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15910:x1876035258948992:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 976us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127099.845125:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:1.0:1789127099.856860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.857485:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258949248 00000100:00100000:3.0:1789127099.857497:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258949248 00000100:00100000:3.0:1789127099.857553:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1789127099.857565:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+28:15910:x1876035258949248:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127099.857606:0:17875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127099.857630:0:17875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec2a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8e1 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857766:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857783:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857796:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127099.857806:0:17875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127099.857889:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857897:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857904:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.857909:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127099.857914:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858763:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858779:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:3.0:1789127099.858791:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127099.858799:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858805:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666ec2ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858864:0:17875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec2a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8e1 expref: 30 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858875:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99410261f400) 00010000:00010000:3.0:1789127099.858878:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127099.858881:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3800/0xa840b4da666ec2a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8e1 expref: 30 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.858893:0:17875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3800, rc 0) 00000100:00100000:3.0:1789127099.859041:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+29:15910:x1876035258949248:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1477us (2199us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789127099.859051:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1789127099.873758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.873847:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258949376 00000100:00100000:0.0:1789127099.873867:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258949376 00000100:00100000:0.0:1789127099.873940:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:0.0:1789127099.873953:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+29:15910:x1876035258949376:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127099.874001:0:17877:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127099.874130:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+29:15910:x1876035258949376:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.874138:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1789127099.886693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.886764:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258949632 00000100:00100000:3.0:1789127099.886775:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258949632 00000100:00100000:3.0:1789127099.886857:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1789127099.886869:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+29:15910:x1876035258949632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127099.886892:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127099.886966:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8e8 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127099.887375:0:19940:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1789127099.887382:0:19940:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789127099.887404:0:19940:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789127099.887560:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.887929:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.888123:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.888188:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8e8 expref: 32 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.888206:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8e8 expref: 31 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.888214:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06500) 00010000:00010000:0.0:1789127099.888217:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127099.888222:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364caa00, rc 0) 00000100:00100000:0.0:1789127099.888380:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+31:15910:x1876035258949632:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1512us (1733us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789127099.888389:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1789127099.909124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.909282:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258949888 00000100:00100000:0.0:1789127099.909304:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258949888 00000100:00100000:0.0:1789127099.909372:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1789127099.909384:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+31:15910:x1876035258949888:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127099.909456:0:17876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127099.909496:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8e8 expref: 31 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909516:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06500) 00010000:00010000:0.0:1789127099.909526:0:17876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127099.909549:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909565:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909585:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909638:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909646:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909704:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909747:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909753:0:17876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909758:0:17876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909771:0:17876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbe00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127099.909775:0:17876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909781:0:17876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909789:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:0.0:1789127099.909792:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127099.909796:0:17876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909801:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909810:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909815:0:17876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909821:0:17876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909825:0:17876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cba00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127099.909827:0:17876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909833:0:17876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909861:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa935e019 (ffff994102e06100) 00010000:00010000:0.0:1789127099.909863:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127099.909866:0:17876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.909872:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa935e019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127099.910205:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+30:15910:x1876035258949888:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 822us (1092us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127099.910213:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:2.0:1789127099.915642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.915783:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258950016 00000100:00100000:0.0:1789127099.915795:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258950016 00000100:00100000:0.0:1789127099.915861:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:0.0:1789127099.915872:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+30:15910:x1876035258950016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127099.915892:0:20680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127099.915916:0:20680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8ef expref: -99 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.915963:0:20680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.915979:0:20680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.915993:0:20680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.916115:0:20680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cba00/0xa840b4da666ec2dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8ef expref: 32 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.916144:0:20680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8ef expref: 31 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.916153:0:20680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127099.916157:0:20680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127099.916161:0:20680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cbe00, rc 0) 00000100:00100000:0.0:1789127099.916216:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+31:15910:x1876035258950016:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 345us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.916224:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1789127099.919097:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.919350:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258950272 00000100:00100000:0.0:1789127099.919360:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258950272 00000100:00100000:0.0:1789127099.919422:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789127099.919432:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+31:15910:x1876035258950272:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127099.919522:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.919542:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.919555:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127099.919752:0:19940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789127099.919761:0:19940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 525124111841ns, next at 526124109894ns, rc = 0 00000004:00010000:0.0:1789127099.919802:0:19940:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000785d3114 reply state 000000001a70d688 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.919830:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.919837:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127099.919840:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127099.919844:0:19940:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127099.920175:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+33:15910:x1876035258950272:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 743us (1085us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789127099.920183:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:1.0:1789127099.924232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.924325:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258950400 00000100:00100000:2.0:1789127099.924336:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258950400 00000100:00100000:2.0:1789127099.924400:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1789127099.924410:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+33:15910:x1876035258950400:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127099.924434:0:17877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127099.924457:0:17877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8f6 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.924527:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 34 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.924543:0:17877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 34 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.924562:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:2.0:1789127099.924566:0:17877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127099.924581:0:17877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588c00, rc 0) 00000100:00100000:2.0:1789127099.924645:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+34:15910:x1876035258950400:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 236us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.924688:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1789127099.930002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.930591:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258950528 00000100:00100000:0.0:1789127099.930602:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258950528 00000100:00100000:0.0:1789127099.930715:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1789127099.930728:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2392:x1876035258950528:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789127099.930732:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127099.930989:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2392:x1876035258950528:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 264us (994us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789127099.930998:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789127099.938132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.938225:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258950784 00000100:00100000:0.0:1789127099.938236:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258950784 00000100:00100000:0.0:1789127099.938295:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1789127099.938305:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+34:15910:x1876035258950784:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789127099.938730:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+35:15910:x1876035258950784:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 425us (606us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789127099.938740:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1789127099.946090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.946256:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951040 00000100:00100000:2.0:1789127099.946267:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951040 00000100:00100000:2.0:1789127099.946327:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:2.0:1789127099.946350:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+35:15910:x1876035258951040:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789127099.946468:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+35:15910:x1876035258951040:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.946476:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:2.0:1789127099.950451:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127099.950534:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951168 00000100:00100000:1.0:1789127099.950545:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951168 00000100:00100000:1.0:1789127099.950602:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:1.0:1789127099.950613:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+35:15910:x1876035258951168:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127099.950632:0:17876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127099.950688:0:17876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec2f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c8fd expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950755:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950772:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950784:0:17876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127099.950825:0:17876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127099.950869:0:17876:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950896:0:17876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec2f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8fd expref: 37 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950913:0:17876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8fd expref: 36 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127099.950922:0:17876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:1.0:1789127099.950924:0:17876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789127099.950938:0:17876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166e00, rc 0) 00000100:00100000:1.0:1789127099.951005:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+36:15910:x1876035258951168:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 394us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127099.951012:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:1.0:1789127099.966922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.967433:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951296 00000100:00100000:0.0:1789127099.967444:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951296 00000100:00100000:0.0:1789127099.967524:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789127099.967534:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942065b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2394:x1876035258951296:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127099.967553:0:19386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127099.967574:0:19386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c904 expref: -99 pid: 19386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127099.967596:0:19386:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3e9bb, blocks: 0x0 00010000:00010000:0.0:1789127099.967617:0:19386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1789127099.967621:0:19386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127099.967630:0:19386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 7 pid: 19386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.967700:0:19386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 7 pid: 19386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.967727:0:19386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cba00, rc 0) 00000100:00100000:0.0:1789127099.967797:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942065b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2394:x1876035258951296:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 264us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.967806:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1789127099.977189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.977321:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951552 00000100:00100000:0.0:1789127099.977332:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951552 00000100:00100000:0.0:1789127099.977399:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1789127099.977410:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+36:15910:x1876035258951552:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127099.977522:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+36:15910:x1876035258951552:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.977530:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1789127099.980488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.980576:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951680 00000100:00100000:0.0:1789127099.980586:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951680 00000100:00100000:0.0:1789127099.980708:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:0.0:1789127099.980719:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+36:15910:x1876035258951680:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789127099.982939:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789127099.982953:0:17857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789127099.983019:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789127099.983174:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983187:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983196:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983203:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127099.983208:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983217:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983236:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:0.0:1789127099.983239:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789127099.983245:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.983253:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ec193 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127099.983391:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15910:x1876035258951680:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 2669us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127099.983401:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1789127099.983497:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127099.983514:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276849280:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789127099.983935:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.983945:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.983952:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.983957:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.983961:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.983968:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.983988:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994103eaba00) 00010000:00010000:2.0:1789127099.983991:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127099.983995:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984001:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec13f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984018:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984030:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984036:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984042:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.984044:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984050:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984059:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:2.0:1789127099.984061:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127099.984064:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984070:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec146 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984083:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984095:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984101:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984106:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cae00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.984115:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984122:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984131:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff994102e06900) 00010000:00010000:2.0:1789127099.984133:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127099.984136:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984141:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cae00/0xa840b4da666ec1ee lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984158:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984166:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984172:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984177:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.984180:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984185:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984193:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127099.984195:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127099.984204:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984215:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ec273 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984227:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984234:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984240:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984245:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127099.984247:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984253:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984260:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:2.0:1789127099.984262:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789127099.984265:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.984271:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364caa00/0xa840b4da666ec2ea lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127099.985264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127099.985401:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276849280 00000100:00100000:0.0:1789127099.985409:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276849280 00000100:00100000:0.0:1789127099.985478:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127099.985487:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276849280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789127099.985605:0:19387:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789127099.985609:0:19387:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789127099.985611:0:19387:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789127099.985614:0:19387:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789127099 -> 1789127099 00002000:00010000:0.0:1789127099.985616:0:19387:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789127099.985705:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876035276849280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (437us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789127099.985713:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789127099.985820:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789127099.985894:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994219ee1680/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789127099.985901:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276849280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789127099.987566:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127099.987636:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258951808 00000100:00100000:3.0:1789127099.987643:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258951808 00000100:00100000:2.0:1789127099.988231:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1789127099.988243:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2393:x1876035258951808:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789127099.988358:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2393:x1876035258951808:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 117us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.988367:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1789127099.990462:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.990536:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952064 00000100:00100000:0.0:1789127099.990546:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952064 00000100:00100000:0.0:1789127099.990599:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:0.0:1789127099.990609:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+15:15910:x1876035258952064:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127099.990676:0:17877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127099.990706:0:17877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ec2ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8fd expref: 15 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.990724:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127099.990730:0:17877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127099.990757:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.990772:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.990783:0:17877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127099.990918:0:17877:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000126b220e reply state 00000000b67c3fe8 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.990931:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127099.990938:0:17877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127099.990941:0:17877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127099.990943:0:17877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127099.991077:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+16:15910:x1876035258952064:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 468us (622us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789127099.991085:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1789127099.992865:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.992952:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952192 00000100:00100000:2.0:1789127099.992960:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952192 00000100:00100000:2.0:1789127099.993019:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789127099.993028:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+7:15910:x1876035258952192:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127099.993047:0:19388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127099.993065:0:19388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c90b expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.993097:0:19388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.993107:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127099.993112:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127099.993118:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.993152:0:19388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.993167:0:19388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127099.993198:0:19388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19388:1876035276849408:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789127099.993277:0:19388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942121b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127099.995983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127099.996100:0:19388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19388:1876035276849408:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127099.996133:0:19388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127099.996161:0:19388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589200, rc 0) 00000100:00100000:2.0:1789127099.996225:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+8:15910:x1876035258952192:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3198us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127099.996236:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1789127099.996366:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952320 00000100:00100000:3.0:1789127099.996372:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952320 00010000:00010000:3.0:1789127099.996402:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127099.996428:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789127099.996435:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+8:2393:x1876035258952320:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127099.996447:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127099.996462:0:20223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.996473:0:20223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.996492:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a681db7/0xa840b4da666ec306 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c904 expref: 8 pid: 19386 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.996503:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127099.996506:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127099.996511:0:20223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 7 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.996533:0:20223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 7 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127099.996561:0:20223:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 7 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127099.996573:0:20223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20223:1876035276849536:192.168.203.23@tcp:105: 00000100:00100000:3.0:1789127099.996626:0:20223:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213b10cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127099.999488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127099.999662:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952448 00000100:00100000:0.0:1789127099.999672:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952448 00000100:00100000:0.0:1789127099.999731:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1789127099.999743:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+8:2391:x1876035258952448:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789127099.999883:0:20286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789127099.999887:0:20286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789127099 00002000:00010000:0.0:1789127099.999890:0:20286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789127098 00002000:00010000:0.0:1789127099.999893:0:20286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789127099 -> 1789127099 00002000:00010000:0.0:1789127099.999896:0:20286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789127099.999953:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+9:2391:x1876035258952448:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 212us (473us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789127099.999963:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1789127100.000727:0:20223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20223:1876035276849536:192.168.203.23@tcp:105: 00010000:00010000:3.0:1789127100.000918:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127100.002755:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+8:2393:x1876035258952320:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 6309us (6771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127100.002769:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1789127100.003126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127100.003279:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952576 00000100:00100000:2.0:1789127100.003599:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952576 00000100:00100000:0.0:1789127100.003686:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1789127100.003701:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+8:2394:x1876035258952576:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789127100.003761:0:19387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.003782:0:19387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.003792:0:19387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127100.003797:0:19387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127100.003802:0:19387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.003837:0:19387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.003868:0:19387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.003884:0:19387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19387:1876035276849664:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127100.004023:0:19387:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127100.020447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127100.020543:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952704 00000100:00100000:1.0:1789127100.020555:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952704 00010000:00010000:1.0:1789127100.020601:0:17864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 9 pid: 19388 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127100.020687:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1789127100.020713:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+9:2394:x1876035258952704:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127100.020731:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127100.020754:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 9 pid: 19388 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.020770:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 9 pid: 19388 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.020800:0:17864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127100.020805:0:17864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127100.020812:0:17864:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.020823:0:17864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.020846:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127100.020907:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+9:2394:x1876035258952704:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 196us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127100.020915:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00010000:00010000:0.0:1789127100.022686:0:19387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca603bb/0xa840b4da666ec314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c90b expref: 8 pid: 19388 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.022710:0:19387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19387:1876035276849664:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127100.022734:0:19387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022767:0:19387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022775:0:19387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022803:0:19387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022812:0:19387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022822:0:19387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022829:0:19387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127100.022833:0:19387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022842:0:19387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022871:0:19387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.022891:0:19387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd177214/0xa840b4da666ec31b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.023037:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+7:2394:x1876035258952576:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 19278us (19849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127100.023113:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:3.0:1789127100.025312:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127100.025404:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258952960 00000100:00100000:2.0:1789127100.025415:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258952960 00000100:00100000:2.0:1789127100.025478:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1789127100.025490:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+16:15910:x1876035258952960:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789127100.025571:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.025591:0:17875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 16 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.025601:0:17875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.025776:0:17875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 16 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.025792:0:17875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 16 pid: 17876 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127100.025808:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276849792:192.168.203.23@tcp:104: 00000100:00100000:2.0:1789127100.025934:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942121b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127100.033460:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276849792:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127100.033493:0:17875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127100.034283:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127100.034468:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953088 00000100:00100000:2.0:1789127100.034476:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953088 00010000:00010000:2.0:1789127100.034518:0:17862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 17 pid: 17876 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127100.034556:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1789127100.034567:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+17:2394:x1876035258953088:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127100.034583:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127100.034590:0:17862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 17 pid: 17876 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034603:0:17862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 17 pid: 17876 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034645:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ec26c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8cc expref: 17 pid: 17876 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034704:0:17862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:2.0:1789127100.034711:0:17862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 16 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034721:0:17862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034729:0:17862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034736:0:17862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.034761:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127100.034819:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+16:2394:x1876035258953088:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 253us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127100.034828:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00010000:00010000:0.0:1789127100.035236:0:17875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035245:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035436:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035449:0:17875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 16 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035457:0:17875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035491:0:17875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 16 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.035505:0:17875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 16 pid: 17877 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.035518:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276849920:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127100.035598:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127100.038820:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127100.038913:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953216 00000100:00100000:1.0:1789127100.038923:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953216 00010000:00010000:1.0:1789127100.038979:0:17864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 17 pid: 17877 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127100.039023:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:1.0:1789127100.039034:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+17:2393:x1876035258953216:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127100.039075:0:17864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127100.039084:0:17864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 17 pid: 17877 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.039098:0:17864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 17 pid: 17877 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.039123:0:17864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:1.0:1789127100.039128:0:17864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.039138:0:17864:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.039147:0:17864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.039166:0:17864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127100.039224:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+17:2393:x1876035258953216:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 193us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127100.039233:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00010000:00010000:0.0:1789127100.042792:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588c00/0xa840b4da666ec2f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8f6 expref: 16 pid: 17877 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.042819:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276849920:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127100.042843:0:17875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.043141:0:17875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.043150:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127100.043260:0:17875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789127100.043365:0:17875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789127100.043398:0:17875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789127100.043505:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17875:1876035276850048:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789127100.043568:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127100.043603:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213ca7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127100.043763:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850048 00000100:00100000:1.0:1789127100.043772:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850048 00000100:00100000:1.0:1789127100.043823:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127100.043832:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17875:x1876035276850048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789127100.043935:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17875:x1876035276850048:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127100.043944:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127100.044060:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17875:1876035276850048:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789127100.044197:0:17875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789127100.044239:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17875:1876035276850176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789127100.044284:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127100.044295:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127100.044458:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850176 00000100:00100000:1.0:1789127100.044462:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850176 00000100:00100000:1.0:1789127100.044478:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127100.044484:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17875:x1876035276850176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789127100.044589:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17875:x1876035276850176:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (303us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789127100.044595:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127100.044737:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17875:1876035276850176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789127100.044768:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044777:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044784:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044789:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127100.044794:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044803:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044826:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127100.044829:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127100.044835:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044841:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb400/0xa840b4da666ec329 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044881:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044889:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044895:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044901:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127100.044905:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044911:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044919:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127100.044922:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127100.044928:0:17875:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 19 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.044941:0:17875:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 19 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.045115:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 19 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.045172:0:17875:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 19 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.045184:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276850304:192.168.203.23@tcp:105: 00000100:00100000:0.0:1789127100.045244:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127100.047289:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17875:1876035276850304:192.168.203.23@tcp:105: 00010000:00010000:0.0:1789127100.047318:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047329:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396c00/0xa840b4da666ec281 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047361:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047377:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047390:0:17875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047401:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047408:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047426:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047433:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127100.047437:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047446:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047457:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127100.047461:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127100.047464:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047470:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ec330 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047480:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047486:0:17875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047492:0:17875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047497:0:17875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127100.047500:0:17875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047517:0:17875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047526:0:17875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:0.0:1789127100.047528:0:17875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127100.047532:0:17875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127100.047538:0:17875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236588400/0xa840b4da666ec322 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127100.047770:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15910:x1876035258952960:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 22280us (22465us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789127100.047782:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000020:00080000:0.0:1789127100.047788:0:17875:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789127100.048754:0:17910:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789127100.048760:0:17910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127100.048797:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789127100.048805:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789127100.050464:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127100.050539:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953344 00000100:00100000:2.0:1789127100.050550:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953344 00000100:00100000:2.0:1789127100.050610:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789127100.050621:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994102eb5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15909:x1876035258953344:12345-192.168.203.23@tcp:49:dd.0 00000100:00100000:2.0:1789127100.050804:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994102eb5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15909:x1876035258953344:12345-192.168.203.23@tcp:49:dd.0 Request processed in 184us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127100.050813:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1789127100.051797:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127100.051887:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953600 00000100:00100000:2.0:1789127100.051893:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953600 00000100:00100000:2.0:1789127100.051968:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789127100.051978:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+19:15910:x1876035258953600:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789127100.052231:0:17880:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789127100.052259:0:17880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789127100.052296:0:17880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052317:0:17880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052327:0:17880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052348:0:17880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052353:0:17880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052357:0:17880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.052375:0:17880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789127100.052443:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15910:x1876035258953600:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 468us (650us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789127100.052448:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000020:00080000:2.0:1789127100.052453:0:17880:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789127100.052502:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127100.052509:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.052516:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127100.052520:0:17865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.052529:0:17865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.052539:0:17865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:1.0:1789127100.052541:0:17865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789127100.052546:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.052550:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994236589600/0xa840b4da666ec337 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.052558:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127100.052559:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127100.052560:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127100.054562:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127100.054916:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953728 00000100:00100000:0.0:1789127100.054928:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953728 00000100:00100000:1.0:1789127100.055082:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1789127100.055092:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+21:15909:x1876035258953728:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:1.0:1789127100.055115:0:19940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127100.055136:0:19940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ec33e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c912 expref: -99 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055169:0:19940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec345 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055185:0:19940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055196:0:19940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055307:0:19940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ec33e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c912 expref: 23 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055323:0:19940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec345 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c912 expref: 22 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.055332:0:19940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127100.055335:0:19940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127100.055338:0:19940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167600, rc 0) 00000100:00100000:1.0:1789127100.055390:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+22:15909:x1876035258953728:12345-192.168.203.23@tcp:101:dd.0 Request processed in 299us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127100.055396:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1789127100.224894:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127100.224948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127100.225104:0:19392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953984 00000100:00100000:0.0:1789127100.225115:0:19392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953984 00000100:00100000:0.0:1789127100.225236:0:19392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258953856 00000100:00100000:0.0:1789127100.225241:0:19392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258953856 00000100:00100000:1.0:1789127100.226600:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127100.226617:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+8:2392:x1876035258953984:12345-192.168.203.23@tcp:4:dd.0 00002000:00010000:1.0:1789127100.226697:0:19393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3e9bb, atime: 0x6aa3e9ba, ctime: 0x6aa3e9bb, blocks: 0x0 00010000:00010000:1.0:1789127100.226708:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.226725:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1789127100.226730:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127100.226737:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.226753:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127100.345881:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1789127100.345901:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1789127100.346230:0:19393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1789127100.346235:0:19393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1789127100.346254:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346266:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346274:0:19393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346281:0:19393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127100.346286:0:19393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346311:0:19393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346334:0:19393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.346343:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f3f01a/0xa840b4da666ec34c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127100.347225:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+6:2392:x1876035258953984:12345-192.168.203.23@tcp:4:dd.0 Request processed in 120603us (122330us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789127100.347236:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127100.347799:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1789127100.347815:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2392:x1876035258953856:12345-192.168.203.23@tcp:4:dd.0 00002000:00010000:1.0:1789127100.348068:0:19393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6aa3e9bb, atime: 0x6aa3e9ba, ctime: 0x6aa3e9bb, blocks: 0x1a68 00010000:00010000:1.0:1789127100.348077:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.348094:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1789127100.348098:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127100.348106:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127100.348120:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127100.437590:0:19382:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789127100.437971:0:19393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1789127100.438177:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438191:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438200:0:19393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438206:0:19393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127100.438211:0:19393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438239:0:19393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438264:0:19393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127100.438272:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d43a65/0xa840b4da666ec353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127100.438453:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2392:x1876035258953856:12345-192.168.203.23@tcp:4:dd.0 Request processed in 90635us (213494us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789127100.438469:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00010000:00010000:3.0:1789127100.459015:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127100.587338:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127100.587364:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276850432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127100.587460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127100.587541:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850432 00000100:00100000:1.0:1789127100.587550:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850432 00000100:00100000:1.0:1789127100.587613:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127100.587624:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276850432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127100.587686:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789127100.587743:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276850432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127100.587751:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127100.587799:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276850432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127101.098911:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276850560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127101.098993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127101.099096:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850560 00000100:00100000:1.0:1789127101.099106:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850560 00000100:00100000:1.0:1789127101.099161:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127101.099170:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276850560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127101.099207:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127101.099266:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276850560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127101.099274:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127101.099367:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276850560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127101.484153:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127101.613674:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127101.613699:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276850688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127101.613772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127101.614142:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850688 00000100:00100000:1.0:1789127101.614152:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850688 00000100:00100000:1.0:1789127101.614234:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127101.614246:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276850688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127101.614273:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923509248 avail 3684282368 00000100:00100000:1.0:1789127101.614337:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276850688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127101.614363:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127101.614532:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276850688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789127101.614782:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789127102.123991:0:17910:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789127102.123999:0:17910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127102.124018:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789127102.124024:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789127102.507325:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127102.518007:0:21065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789127102.637402:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127102.637430:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276850816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127102.637504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127102.641137:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850816 00000100:00100000:1.0:1789127102.641154:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850816 00000100:00100000:3.0:1789127102.641905:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127102.641919:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276850816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127102.642376:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127102.642484:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276850816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 567us (4977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127102.642493:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789127102.642522:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127102.642726:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276850816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127102.648341:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127102.648364:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276850944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127102.648434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127102.648488:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276850944 00000100:00100000:3.0:1789127102.648496:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276850944 00000100:00100000:3.0:1789127102.648571:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127102.648581:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276850944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127102.648604:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127102.648666:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276850944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127102.648691:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789127102.648713:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127102.648747:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276850944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127102.649372:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276851072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127102.649409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127102.649501:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851072 00000100:00100000:1.0:1789127102.649507:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851072 00000100:00100000:1.0:1789127102.649564:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127102.649574:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276851072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127102.649596:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127102.649633:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276851072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127102.649639:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127102.649692:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789127102.649697:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994219ee1680, transno 8589934596 00000004:00080000:1.0:1789127102.649707:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789127102.649727:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276851072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789127102.651587:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127102.652186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276851328:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652303:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276851840:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652347:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276852352:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652388:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789127102.652394:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276851200:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652445:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276851712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652487:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276852224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652531:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276851456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652568:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276851968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652603:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789127102.652609:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276851584:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652669:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276852096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127102.652712:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851840 00000100:00100000:0.0:1789127102.652720:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851840 00000100:00100000:0.0:1789127102.652757:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852352 00000100:00100000:0.0:1789127102.652760:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852352 00000100:00100000:0.0:1789127102.652783:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852224 00000100:00100000:0.0:1789127102.652786:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852224 00000100:00100000:0.0:1789127102.652807:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851456 00000100:00100000:0.0:1789127102.652809:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851456 00000100:00100000:0.0:1789127102.652820:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851968 00000100:00100000:0.0:1789127102.652822:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851968 00000100:00100000:0.0:1789127102.652847:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852096 00000100:00100000:0.0:1789127102.652851:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852096 00000100:00100000:0.0:1789127102.652868:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789127102.652876:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276851840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652930:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276851840:12345-0@lo:400:kworker.0 Request processed in 54us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.652937:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789127102.652953:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789127102.652959:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.652987:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276852352:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.652993:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789127102.653004:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127102.653010:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276852224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653036:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276852224:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653042:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127102.653052:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127102.653057:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276851456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653087:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276851456:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653095:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127102.653106:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127102.653118:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653148:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276851968:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653153:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127102.653166:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127102.653172:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653200:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276852096:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653205:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127102.653226:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851200 00000100:00100000:0.0:1789127102.653229:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851200 00000100:00100000:0.0:1789127102.653252:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789127102.653258:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276851200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653284:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276851200:12345-0@lo:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653291:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789127102.653319:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851712 00000100:00100000:0.0:1789127102.653323:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851712 00000100:00100000:0.0:1789127102.653349:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127102.653355:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276851712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653384:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276851712:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653390:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127102.653413:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851328 00000100:00100000:0.0:1789127102.653416:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851328 00000100:00100000:0.0:1789127102.653431:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276851584 00000100:00100000:0.0:1789127102.653434:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276851584 00000100:00100000:0.0:1789127102.653455:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127102.653461:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276851328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653493:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276851328:12345-0@lo:400:kworker.0 Request processed in 32us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653499:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127102.653509:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789127102.653514:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276851584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653538:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276851584:12345-0@lo:400:kworker.0 Request processed in 24us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.653543:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789127102.653557:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127102.653561:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127102.653584:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276851200:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653598:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276851712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653607:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276852224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653616:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276851328:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653625:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276851840:0@lo:400:kworker.0 00010000:00080000:0.0:1789127102.653637:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104019a40 x1876035276852352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127102.653697:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276852352:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653738:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276851584:0@lo:400:kworker.0 00010000:00080000:0.0:1789127102.653747:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f840 x1876035276852096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127102.653767:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276852096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653778:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276851456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127102.653786:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276851968:0@lo:400:kworker.0 00000100:00100000:2.0:1789127102.800325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127102.800397:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954112 00000100:00100000:0.0:1789127102.800409:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954112 00000100:00100000:2.0:1789127102.800412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800443:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127102.800461:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:0.0:1789127102.800472:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258954112:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127102.800479:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800499:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127102.800527:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954624 00000100:00100000:2.0:1789127102.800530:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954624 00000100:00100000:2.0:1789127102.800566:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955136 00000100:00100000:2.0:1789127102.800570:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955136 00000100:00100000:2.0:1789127102.800581:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954496 00000100:00100000:2.0:1789127102.800583:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954496 00000100:00100000:2.0:1789127102.800594:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955008 00000100:00100000:2.0:1789127102.800596:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955008 00000100:00100000:2.0:1789127102.800613:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1789127102.800619:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954624:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127102.802747:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954368 00000100:00100000:1.0:1789127102.802758:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954368 00000100:00100000:1.0:1789127102.802810:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954880 00000100:00100000:1.0:1789127102.802813:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954880 00000100:00100000:1.0:1789127102.802826:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954240 00000100:00100000:1.0:1789127102.802842:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954240 00000100:00100000:1.0:1789127102.802858:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258954752 00000100:00100000:1.0:1789127102.802860:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258954752 00000100:00100000:1.0:1789127102.802880:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:1.0:1789127102.802889:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954368:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127102.803022:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2393:x1876035258954112:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2550us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.803032:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:0.0:1789127102.803075:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789127102.803083:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258955136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127102.803155:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954624:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2534us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127102.803168:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1789127102.804236:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1789127102.804250:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954496:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127102.804290:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954496:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 46us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127102.804297:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1789127102.804310:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:2.0:1789127102.804317:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258955008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127102.804341:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258955008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127102.804347:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:2.0:1789127102.806365:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1789127102.806384:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258954880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127102.806469:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258954880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (6055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127102.806491:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1789127102.806518:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:2.0:1789127102.806526:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+22:2393:x1876035258954240:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127102.806552:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:2.0:1789127102.806553:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+22:2393:x1876035258954240:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (6109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127102.806559:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1789127102.806562:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258954752:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127102.806594:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2393:x1876035258954752:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 33us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127102.806601:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00080000:3.0:1789127102.806637:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127102.806642:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127102.806645:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127102.806669:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127102.808991:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2393:x1876035258954368:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 6092us (8612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127102.808991:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2393:x1876035258955136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 5898us (8550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127102.809006:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1789127102.809006:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00010000:00010000:3.0:1789127103.539478:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127104.576378:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43294 lines, 43294 kept, 0 dropped, 0 bad.